-- Logs begin at Wed 2022-05-11 05:08:06 UTC, end at Wed 2022-05-11 06:13:52 UTC. -- May 11 05:48:43.953948 dv-cinder-733623-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 05:48:43.962448 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 05:48:43 2022] *** May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: nodename: dv-cinder-733623-13-iscsi May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: machine: x86_64 May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: clock source: unix May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: pcre jit disabled May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: detected number of CPU cores: 4 May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: current working directory: / May 11 05:48:43.964460 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: detected binary path: /usr/bin/uwsgi-core May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: your processes number limit is 47680 May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: your memory page size is 4096 bytes May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: detected max file descriptor number: 2048 May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: lock engine: pthread robust mutexes May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: thunder lock: enabled May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 05:48:43.965159 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 05:48:44.008838 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: Python main interpreter initialized at 0x558eb2c7a9c0 May 11 05:48:44.008838 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: python threads support enabled May 11 05:48:44.008838 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: your server socket listen backlog is limited to 100 connections May 11 05:48:44.008838 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: your mercy for graceful operations on workers is 90 seconds May 11 05:48:44.009151 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: mapped 403077 bytes (393 KB) for 2 cores May 11 05:48:44.009225 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: *** Operational MODE: preforking *** May 11 05:48:44.009502 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: *** uWSGI is running in multiple interpreter mode *** May 11 05:48:44.009502 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: spawned uWSGI master process (pid: 102778) May 11 05:48:44.009728 dv-cinder-733623-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 05:48:44.010480 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: spawned uWSGI worker 1 (pid: 102779, cores: 1) May 11 05:48:44.010583 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: spawned uWSGI worker 2 (pid: 102780, cores: 1) May 11 05:48:44.010760 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 05:48:45.204333 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 05:48:45.241112 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 05:48:45.946765 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:48:45.946765 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: from cryptography.utils import int_from_bytes May 11 05:48:45.947659 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:48:45.947659 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: from cryptography.utils import int_from_bytes May 11 05:48:45.970892 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:48:45.970892 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: from cryptography.utils import int_from_bytes May 11 05:48:45.971219 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:48:45.971219 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: from cryptography.utils import int_from_bytes May 11 05:48:48.595120 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:48:48.595690 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:48:48.596041 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:48:48.596141 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:48:48.596235 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:48:48.596323 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:48:48.596409 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:48:48.596495 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:48:48.596587 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:48:48.596704 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:48:48.596849 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597090 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597177 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597419 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597539 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597776 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.597888 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598098 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598202 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598504 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598729 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.598814 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599047 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599143 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599365 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599459 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599628 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599723 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.599945 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600048 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600263 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600348 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733623-13-iscsi {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600590 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733623-13-iscsi {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600694 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.600911 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601006 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601220 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601312 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601559 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601696 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601860 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.601982 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602175 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602270 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602478 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602572 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602792 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.602976 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.604641 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.604771 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.604845 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.604921 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.604989 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605054 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605119 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605184 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605256 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605336 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605549 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605636 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605790 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.605885 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606111 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606215 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606423 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606516 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606744 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.606831 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607053 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607148 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733623-13-iscsi {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607445 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607542 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733623-13-iscsi {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607758 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.607844 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608072 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608165 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608385 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608500 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608771 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.608864 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609076 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609166 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609392 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609500 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609737 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.609836 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610049 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610139 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610355 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610441 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610675 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610790 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.610988 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611079 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611302 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611396 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611606 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611714 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.611907 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612003 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612223 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612317 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612511 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612646 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612810 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.612901 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613111 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613203 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613361 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613455 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613674 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613761 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.613983 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614067 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614305 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614403 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614627 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614719 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.614951 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615058 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615208 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615296 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615460 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615546 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615780 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.615876 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616100 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616208 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616409 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616506 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616707 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.616806 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617009 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617095 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617310 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617397 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617644 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617753 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.617952 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.618038 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.618259 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.618372 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.618563 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.618651 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.619448 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.619588 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.619761 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.619918 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620081 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620226 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620389 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620553 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620725 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.620952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621108 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621205 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621360 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621509 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621689 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.621850 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622030 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622167 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622350 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622471 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622659 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622788 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.622978 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623106 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623298 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623396 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623606 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623702 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623911 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.623997 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624216 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624306 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624535 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624635 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624859 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.624946 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625113 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625198 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625409 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625539 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625736 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.625823 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626041 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626128 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626340 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626434 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626642 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626734 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.626943 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627036 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627242 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627329 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627541 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627633 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627840 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.627935 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628141 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628229 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628442 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628529 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628739 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.628824 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629040 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629128 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629339 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629431 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629749 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.629965 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630053 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630269 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630362 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630585 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630883 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.630980 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631185 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631283 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631481 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631585 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631783 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.631870 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632089 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632177 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632387 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632471 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632687 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632774 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.632989 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633075 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633286 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633373 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633610 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633702 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.633912 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634008 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634212 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634306 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634618 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634836 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.634928 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635008 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635203 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635298 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635504 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635591 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.635807 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636154 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636359 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636459 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636661 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636754 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.636961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637054 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637259 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637422 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637579 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637664 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637878 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.637966 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638176 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638263 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638475 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638577 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638767 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.638858 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639063 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639149 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639377 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639472 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639677 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639761 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.639980 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640067 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640281 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640367 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640585 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640668 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640904 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:48:48.640994 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641234 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641349 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641584 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641703 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641893 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.641980 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642226 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642323 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642552 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642648 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642868 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.642953 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643178 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643262 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643488 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643596 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643804 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.643901 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644108 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644201 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644415 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644508 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644725 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.644810 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645039 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645130 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645352 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645437 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645692 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.645787 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646002 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646086 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646315 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646408 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646628 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646713 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.646935 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647020 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647246 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647331 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647565 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647651 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647879 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.647963 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648187 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648282 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648501 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648652 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648843 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.648984 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649140 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649280 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649457 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649588 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649796 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.649898 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.650143 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.650271 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.650455 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.650551 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.650768 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651047 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651145 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651379 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651477 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651707 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.651803 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652016 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652103 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652331 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652416 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652641 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652734 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.652949 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653044 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653257 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653342 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653586 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653686 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.653901 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654217 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654350 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654542 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654628 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654862 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.654948 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655174 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655482 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655568 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655799 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.655887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656099 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656192 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656407 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656492 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656712 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.656813 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657013 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657099 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657315 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657408 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657648 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657748 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.657954 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658041 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658253 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658352 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658570 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658658 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658880 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.658967 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659182 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659275 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659505 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659596 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659803 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.659888 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660109 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660271 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660416 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660503 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660718 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.660829 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661016 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661111 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661323 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661426 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661655 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661759 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.661954 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662041 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662271 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662365 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662577 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662665 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662876 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.662969 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663192 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663284 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663492 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663577 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663793 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.663881 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664103 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664198 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664407 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664492 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664713 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.664808 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.665020 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.665114 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.665325 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.665422 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.666199 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.666295 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.666526 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.666837 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.666968 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.667170 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.667418 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.667504 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.667758 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.667845 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668072 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668170 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668403 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668497 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668717 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.668809 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669020 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669116 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669328 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669494 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669665 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669817 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.669969 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670127 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670271 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670435 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670578 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670742 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.670878 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671055 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671184 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671362 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671484 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671672 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671805 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.671982 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672081 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672288 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672376 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672593 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672690 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.672917 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673003 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673228 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673322 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673555 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673644 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673863 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.673949 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674169 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674254 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674509 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674596 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674813 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.674904 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675143 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675235 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675463 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675556 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675774 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.675859 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676088 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676173 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676397 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676484 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676706 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.676790 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677015 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677107 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677321 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677404 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677654 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677752 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.677968 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678063 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678283 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678368 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678592 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678675 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.678909 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679003 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679217 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679303 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679531 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679614 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679833 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.679926 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680148 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680240 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680451 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680544 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680768 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.680862 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.681101 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.681186 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.681981 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682083 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682309 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682396 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682635 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682727 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.682948 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683046 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683265 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683352 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683576 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683661 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683889 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.683980 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684201 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684288 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684506 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684597 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684823 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.684915 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685131 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685225 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685447 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685545 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685784 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.685879 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686102 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686189 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686404 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686496 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686714 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.686812 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687017 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687101 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687331 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687415 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687650 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687743 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.687961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688046 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688273 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688356 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688576 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688668 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.688883 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689023 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689191 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689274 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689512 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689622 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689822 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.689908 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690124 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690214 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690430 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690518 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690733 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.690835 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691045 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691129 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691343 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691444 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691652 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691755 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.691951 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692035 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692253 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692343 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692552 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692646 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692854 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.692948 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693158 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693244 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693462 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693560 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693801 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.693897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694108 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694200 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694407 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694491 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694707 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.694800 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695024 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695109 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695326 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695410 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695628 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695726 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.695929 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696014 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696230 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696315 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696530 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696622 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696832 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.696917 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697253 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697338 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697597 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697698 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697906 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.697991 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698224 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698310 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698545 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698632 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698859 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.698943 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699167 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699261 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699474 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699559 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699782 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.699865 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700090 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700175 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700400 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700486 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700709 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.700794 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701020 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701144 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701330 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701456 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701668 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701785 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.701981 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702090 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702303 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702400 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702612 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702708 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.702920 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703026 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703230 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703336 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703629 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.703842 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.704110 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.704215 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.704442 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.704705 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.704800 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705036 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705139 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705356 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705453 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705692 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.705787 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706009 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706111 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706328 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706424 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706657 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706753 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.706961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707068 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707268 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707366 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707573 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707678 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707874 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.707970 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708181 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708284 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708482 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708586 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708783 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.708932 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709094 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709232 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709364 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709525 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709690 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709789 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.709990 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710076 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710289 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710374 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710588 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710680 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710889 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.710983 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711194 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711281 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711501 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711600 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711803 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.711888 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712114 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712200 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712418 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712525 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712742 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.712839 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713047 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713134 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713349 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713448 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713681 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.713769 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714075 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714171 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714411 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714576 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714738 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.714826 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715074 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715160 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715380 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715467 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715740 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.715826 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716049 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716137 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716359 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716446 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716751 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.716971 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717058 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717274 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717368 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717603 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717704 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717907 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.717995 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718217 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718303 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718521 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718607 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718830 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.718923 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719135 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719221 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719436 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719525 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719743 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.719838 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720041 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720133 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720347 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720440 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720650 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720744 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.720957 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721051 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721258 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721345 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721579 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721680 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721885 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.721979 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722183 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722269 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722487 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722575 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722784 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.722869 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723091 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723175 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723390 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723476 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723691 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723777 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.723991 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724077 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724293 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724380 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724595 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724680 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724894 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.724979 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725204 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725290 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725525 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725615 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725825 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.725922 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726124 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726211 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726429 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726516 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726729 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.726827 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727026 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727111 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727328 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727420 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727630 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727726 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.727938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.728022 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.728752 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.728864 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729056 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729156 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729356 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729509 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729684 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729770 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.729984 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730081 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730286 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730372 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730727 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730861 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.730982 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731096 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731201 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731305 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731443 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731534 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731742 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.731838 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732040 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732132 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732343 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732440 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732640 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732726 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.732943 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733030 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733242 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733340 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733571 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733877 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.733976 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734221 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734316 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734520 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734607 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734830 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.734917 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735146 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735241 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735454 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735542 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735759 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.735845 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736068 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736167 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736368 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736462 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736679 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736765 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.736984 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737071 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737293 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737382 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737623 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737712 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.737924 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738020 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738230 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738315 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738533 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738619 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738838 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.738933 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739149 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739234 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739461 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739591 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739779 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.739873 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740081 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740168 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740385 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740479 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740689 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740776 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.740992 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741078 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741300 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741393 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741624 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741723 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.741931 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742018 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742238 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742356 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742543 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742638 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742849 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.742937 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743154 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743320 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743456 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743560 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743761 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.743902 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744118 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744288 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744446 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744561 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744720 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.744818 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745022 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745110 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745320 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745406 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745647 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745737 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.745948 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746036 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746254 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746339 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746552 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746638 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746857 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.746974 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747162 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747282 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747587 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747687 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747885 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.747971 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748191 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748278 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748496 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748592 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748804 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.748889 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749110 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749196 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749409 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749560 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749818 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.749915 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750123 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750211 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750433 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750528 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750740 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.750827 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751043 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751138 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751345 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751448 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751652 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751754 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.751970 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752057 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752270 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752359 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752569 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752657 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752869 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.752955 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753187 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753275 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753501 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753592 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753822 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.753909 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754125 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754221 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754446 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754546 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754815 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.754902 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755168 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755255 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755479 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755573 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755810 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.755905 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756127 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756226 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756443 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756530 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756763 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.756859 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757065 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757151 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757375 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757608 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757704 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.757786 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758017 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758121 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758327 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758415 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758631 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758723 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.758942 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.759045 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.759242 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.759330 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760088 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760225 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760395 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760498 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760704 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.760791 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.761272 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.761362 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.761612 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.761704 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.761935 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762022 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762311 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762396 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762629 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762718 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.762951 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763036 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763250 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763335 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763552 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763641 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763876 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.763969 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764177 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764274 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764481 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764568 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764782 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.764876 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765088 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765188 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765391 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765505 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765723 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.765811 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766029 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766130 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766329 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766418 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766629 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766716 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.766931 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767025 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767234 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767319 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767551 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767639 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767852 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.767950 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768168 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768254 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768480 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768565 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768779 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.768866 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769096 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769182 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769399 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769504 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769722 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.769809 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770022 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770164 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770322 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770408 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770622 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770710 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.770926 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771013 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771253 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771338 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771561 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771649 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771881 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.771986 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772184 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772279 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772524 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772613 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772832 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.772918 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773146 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773254 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773458 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773576 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773798 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.773886 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774097 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774194 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774393 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774490 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774701 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.774788 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.775001 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.775119 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.775837 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.775933 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776138 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776313 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776443 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776626 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776742 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.776936 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777043 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777247 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777344 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777580 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777718 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777888 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.777987 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778194 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778292 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778517 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778605 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778823 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.778912 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779126 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779213 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779425 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779511 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779736 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.779821 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780044 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780140 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780350 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780448 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780670 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780756 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.780980 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781074 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781309 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781394 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781640 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781742 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.781960 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782049 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782271 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782363 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782585 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782680 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782897 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.782984 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783209 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783297 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783519 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783688 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783831 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.783919 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784142 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784231 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784449 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784551 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784760 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.784855 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785069 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785155 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785376 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785489 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785722 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.785924 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786039 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786253 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786343 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786568 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786863 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.786950 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787230 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787324 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787542 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787630 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787855 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.787950 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788165 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788252 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788472 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788559 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788780 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.788867 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789087 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789173 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789398 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789536 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789734 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.789825 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790045 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790149 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790461 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790701 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.790787 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791018 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791175 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791514 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791735 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.791830 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792090 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792182 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792404 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792491 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792710 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.792797 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793024 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793113 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793339 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793444 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793676 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793780 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.793985 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794073 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794292 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794388 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794604 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794702 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.794914 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795000 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795220 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795306 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795528 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795624 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795837 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.795926 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796146 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796242 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796455 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796558 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796769 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.796857 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797082 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797171 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797398 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797504 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797735 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.797823 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798051 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798147 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798561 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798699 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.798876 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799017 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799206 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799528 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799623 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799841 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.799929 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800154 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800250 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800469 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800557 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800793 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.800880 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801100 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801195 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801404 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801522 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801738 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.801826 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802049 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802149 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802349 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802435 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802657 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802782 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.802963 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803059 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803264 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803398 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803581 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803666 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803888 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.803977 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.804190 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.804413 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.804500 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.804757 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.804862 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.805070 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.805325 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.805413 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.805705 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.805797 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.806028 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.806127 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.806365 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.806545 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.806795 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807051 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807146 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807229 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807397 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807492 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807712 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.807808 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808024 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808118 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808326 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808415 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808707 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.808960 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809070 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809280 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809379 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809616 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809714 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.809922 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810020 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810231 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810316 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810534 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810641 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810843 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.810935 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811148 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811235 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811452 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811548 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811767 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.811852 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812077 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812162 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812382 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812481 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812689 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812796 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.812996 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813100 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813297 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813572 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813670 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813749 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.813919 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814005 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814225 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814313 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814529 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814615 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814837 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.814930 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815140 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815234 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815443 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815536 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815752 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.815836 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816061 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816149 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816381 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816466 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816724 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.816816 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817031 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817120 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817337 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817424 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817677 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817767 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.817998 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818084 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818298 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818391 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818612 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818707 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.818924 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.819020 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.819270 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.819443 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.819585 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.819775 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820092 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820185 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820420 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820506 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820737 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.820838 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821044 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821130 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821346 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821434 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821675 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.821765 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.822659 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.822764 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.822968 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823079 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823294 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823397 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823623 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823708 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.823918 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824021 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824228 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824322 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824538 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824624 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824847 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.824932 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825152 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825240 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825459 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825563 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825791 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.825889 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826101 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826198 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826408 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826501 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826717 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.826816 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827021 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827106 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827336 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827422 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827768 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.827978 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828063 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828292 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828386 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828596 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828683 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828903 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.828997 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829209 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829296 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829536 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829638 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829848 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.829934 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830174 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830307 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830485 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830630 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830827 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.830946 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831208 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831319 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831518 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831617 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831836 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.831967 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832166 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832338 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832486 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832632 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832786 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.832930 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833073 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833300 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833493 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833643 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833839 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.833993 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834160 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834298 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834455 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834605 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834785 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.834956 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835116 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835261 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835416 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835573 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835725 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.835870 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836038 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836185 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836339 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836477 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836636 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836796 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.836956 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.837113 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.837258 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.837405 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.837668 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.838323 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.838470 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.838631 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.838781 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.838925 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.839078 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.839245 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.839415 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.839705 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.839920 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840066 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840211 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840367 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840510 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840657 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840807 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.840952 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841110 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841255 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841399 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841565 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841723 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841881 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.841881 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842179 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842336 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842481 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842648 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842794 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.842953 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843093 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843232 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843359 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843495 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843639 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843840 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843924 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.843990 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.844118 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.844392 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.844563 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.844709 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.844853 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845040 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845172 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845355 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845452 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845705 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.845790 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846018 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846106 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846338 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846432 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846647 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846732 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.846967 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847059 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847287 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847386 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847603 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847689 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847909 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.847994 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848237 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848323 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848546 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848635 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848855 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.848952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849163 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849251 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849488 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849578 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849799 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.849886 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850108 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850197 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850431 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850517 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850751 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.850846 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851053 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851142 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851373 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851466 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851692 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.851827 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852011 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852121 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852327 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852431 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852635 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852740 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.852959 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.853054 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.853346 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.853555 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.853819 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.853910 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854145 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854245 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854457 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854617 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854759 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.854896 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855068 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855206 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855382 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855514 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855705 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.855850 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856029 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856171 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856352 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856488 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856674 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.856805 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857019 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857161 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857332 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857491 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857697 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.857784 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858022 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858107 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858334 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858437 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858640 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858723 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.858944 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.859032 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:48:48.859187 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102779) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:48:48.859281 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102780) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:48:48.882352 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:48.884004 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:48.946722 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.context [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),890801eb-2d5b-42d0-96a3-e70da598d966(cell1) {{(pid=102779) load_cells /opt/stack/nova/nova/context.py:464}} May 11 05:48:48.948138 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.context [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),890801eb-2d5b-42d0-96a3-e70da598d966(cell1) {{(pid=102780) load_cells /opt/stack/nova/nova/context.py:464}} May 11 05:48:48.951765 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:48:48.952484 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:48:48.953380 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:48:48.954064 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:48:48.954174 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:48:48.954891 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:48:48.956060 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_concurrency.lockutils [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102779) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:48:48.956851 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:48:48.967354 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:48.974373 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:48.974624 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:48.977659 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:49.132935 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG oslo_db.sqlalchemy.engines [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102779) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:49.137262 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_db.sqlalchemy.engines [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102780) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:48:49.469184 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:48:49.470610 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:48:49.476387 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:48:49.477833 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:48:49.818704 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:48:49.823422 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:48:49.825083 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: WARNING keystonemiddleware.auth_token [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:48:49.829587 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: WARNING keystonemiddleware.auth_token [None req-a74527f9-f024-4b56-867e-244eaf52fa10 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:48:49.831129 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558eb2c7a9c0 pid: 102780 (default app) May 11 05:48:49.833176 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:48:49.834397 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 May 11 05:48:49.834796 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Wed May 11 05:48:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:48:49.836576 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558eb2c7a9c0 pid: 102779 (default app) May 11 05:50:07.542520 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:07.543536 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 11 05:50:07.544132 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:50:07.957628 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-5de9352d-078d-4a4b-8f01-3f501726f6e9 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:07.988531 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-5de9352d-078d-4a4b-8f01-3f501726f6e9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.437394 May 11 05:50:07.989318 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 05:50:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:10.266891 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:10.267891 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-9ca7707c-f55b-4c7c-a53a-615e89582079 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 11 05:50:10.268325 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:10.328324 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-02b13237-71e6-469b-b38c-f3c8d2664cdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:10.348149 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:50:10.348149 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: warnings.warn(msg) May 11 05:50:10.377877 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-02b13237-71e6-469b-b38c-f3c8d2664cdb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102772 May 11 05:50:10.378689 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:10.593112 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b102ada4-3f12-4487-b94f-852099ec7870 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:10.595468 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:50:10.595468 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:50:10.644854 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b102ada4-3f12-4487-b94f-852099ec7870 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.257272 May 11 05:50:10.658065 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 05:50:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:50:12.934214 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-02b13237-71e6-469b-b38c-f3c8d2664cdb admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:12.935317 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-02b13237-71e6-469b-b38c-f3c8d2664cdb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 May 11 05:50:12.935792 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:13.056238 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ba706cd2-e9f9-4f93-be94-516347b32c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:13.077084 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:50:13.077084 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:50:13.098987 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ba706cd2-e9f9-4f93-be94-516347b32c41 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157252 May 11 05:50:13.099553 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 05:50:13.111224 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-8eec205d-868e-41e9-bf5a-acb504dd1341 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:13.113008 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:50:13.113008 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: warnings.warn(msg) May 11 05:50:13.145282 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-8eec205d-868e-41e9-bf5a-acb504dd1341 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037723 May 11 05:50:13.145884 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 05:50:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:15.430085 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ba706cd2-e9f9-4f93-be94-516347b32c41 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:15.431094 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ba706cd2-e9f9-4f93-be94-516347b32c41 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 May 11 05:50:15.431662 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:15.493392 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c882d9fa-2b61-46f4-91b3-79a99abbf47a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:15.513147 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c882d9fa-2b61-46f4-91b3-79a99abbf47a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075709 May 11 05:50:15.513946 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:15.526238 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bbe9cda3-d93a-4e73-9f84-8a721824d976 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:15.555961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-bbe9cda3-d93a-4e73-9f84-8a721824d976 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033418 May 11 05:50:15.556671 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 05:50:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:17.833242 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c882d9fa-2b61-46f4-91b3-79a99abbf47a admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:17.834216 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c882d9fa-2b61-46f4-91b3-79a99abbf47a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 11 05:50:17.834625 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:17.896415 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-f28b4630-2c27-4abf-85ee-529d0a88d91a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "ram": 2048, "id": "d3", "vcpus": 2, "disk": 10}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:17.915774 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-f28b4630-2c27-4abf-85ee-529d0a88d91a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074669 May 11 05:50:17.916452 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:17.928613 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-969efe1a-3ede-4ab7-9992-20bf67b96571 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:17.952679 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-969efe1a-3ede-4ab7-9992-20bf67b96571 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027910 May 11 05:50:17.953280 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 05:50:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:50:20.258230 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-f28b4630-2c27-4abf-85ee-529d0a88d91a admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:20.259240 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-f28b4630-2c27-4abf-85ee-529d0a88d91a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 11 05:50:20.259811 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:20.319715 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:20.338854 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072918 May 11 05:50:20.339414 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 05:50:20.352658 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-99be497c-15db-4af1-abee-799e007dac11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:20.375223 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-99be497c-15db-4af1-abee-799e007dac11 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027267 May 11 05:50:20.375943 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 05:50:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:22.644430 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:22.646190 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 May 11 05:50:22.646594 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:22.718798 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b059d97e-5e47-4939-825e-2682c78cd414 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:22.742334 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b059d97e-5e47-4939-825e-2682c78cd414 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089120 May 11 05:50:22.742869 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 05:50:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:50:25.180112 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:25.181118 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-9209b8d5-c378-4924-8828-a838fdf1387b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 May 11 05:50:25.181587 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:25.242640 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-7a33ec1a-f8c5-4cd1-8f64-1861599e2548 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:25.261185 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-7a33ec1a-f8c5-4cd1-8f64-1861599e2548 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073212 May 11 05:50:25.261768 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:25.274924 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-02c76b56-6ffb-4e38-8cce-7cc88db079b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:25.297463 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-02c76b56-6ffb-4e38-8cce-7cc88db079b6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027316 May 11 05:50:25.298227 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 05:50:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:27.588165 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-7a33ec1a-f8c5-4cd1-8f64-1861599e2548 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:27.589182 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-7a33ec1a-f8c5-4cd1-8f64-1861599e2548 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 11 05:50:27.589625 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:27.649691 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-b1f9bf52-7b7e-4c37-9921-d34b7f912bef admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:27.669011 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-b1f9bf52-7b7e-4c37-9921-d34b7f912bef admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073376 May 11 05:50:27.669593 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:27.683619 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-d9b03948-2984-426d-bdd2-d00a2e0cf1f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:27.706290 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-d9b03948-2984-426d-bdd2-d00a2e0cf1f5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026456 May 11 05:50:27.706857 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 05:50:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:30.010845 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-b1f9bf52-7b7e-4c37-9921-d34b7f912bef admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:30.012233 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-b1f9bf52-7b7e-4c37-9921-d34b7f912bef admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 May 11 05:50:30.012730 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:30.072494 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-d92cadb1-f325-4c07-93e6-2ec5ff217c67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:30.091065 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-d92cadb1-f325-4c07-93e6-2ec5ff217c67 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072495 May 11 05:50:30.091644 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 05:50:30.103155 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-d5410db9-dd95-463c-85f2-288a2c9c6efe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:30.124953 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-d5410db9-dd95-463c-85f2-288a2c9c6efe admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025517 May 11 05:50:30.125535 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 05:50:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:50:32.377661 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-d92cadb1-f325-4c07-93e6-2ec5ff217c67 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:32.378679 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-d92cadb1-f325-4c07-93e6-2ec5ff217c67 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 11 05:50:32.379077 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:50:32.443845 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-a5eb1214-6d9b-424d-af43-0488238df20f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "vcpus": 4, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:32.462195 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-a5eb1214-6d9b-424d-af43-0488238df20f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077150 May 11 05:50:32.462966 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:32.474475 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-8daa84f2-5c02-476d-8ea8-a8c54e80f9e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:32.498114 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-8daa84f2-5c02-476d-8ea8-a8c54e80f9e2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027262 May 11 05:50:32.498667 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 05:50:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:34.835155 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-a5eb1214-6d9b-424d-af43-0488238df20f admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:34.836323 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-a5eb1214-6d9b-424d-af43-0488238df20f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 May 11 05:50:34.837185 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:34.920515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:34.941318 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.096556 May 11 05:50:34.953610 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 05:50:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:50:34.954026 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-069fd489-e4df-429c-bbfe-ffd788222f9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:50:34.980352 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-069fd489-e4df-429c-bbfe-ffd788222f9f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029737 May 11 05:50:34.980852 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 05:50:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:50:59.393010 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:59.394043 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 11 05:50:59.394438 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:50:59.451033 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-0a21f9f1-5dd8-4974-aefd-0a5a8c78bd33 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:50:59.470376 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-0a21f9f1-5dd8-4974-aefd-0a5a8c78bd33 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069384 May 11 05:50:59.470908 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 05:50:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:51:00.482832 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:00.483826 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-1e977d14-b46e-4de8-99fa-ca3f15ad6bf2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 11 05:51:00.484218 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:00.686622 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-33d321e4-072a-497c-ae69-1d11a3558480 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:00.692134 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-33d321e4-072a-497c-ae69-1d11a3558480 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-33d321e4-072a-497c-ae69-1d11a3558480 admin admin] Request method failure captured: May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept: application/json May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept-Encoding: gzip, deflate May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Connection: keep-alive May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Content-Length: 0 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Host: 10.222.0.44 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-Api-Version: compute 2.90 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-System-Scope: None May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: User-Agent: python-novaclient May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Auth-Token: gAAAAABie07E7bm_dtDwgA10bBtL1kQNm_615M2nVeSXiy1MCHCCyWlu5LTIZhV1BC6bn67gWvdrjd2-1e5_78JPNeUYggPHjiQJmeVPqqiaC54vX9SI9oSUA9RmEpicM88sTVUzYcdxPZ2NrhqPFz9UCUn4wkF5sW4tmPBDyEevkegYd74M_Ds May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Id: None May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Name: None May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Identity-Status: Confirmed May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Is-Admin-Project: True May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Id: default May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Name: Default May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Name: admin May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Role: member,admin,reader May 11 05:51:00.695533 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Roles: member,admin,reader May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant: admin May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Name: admin May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User: admin May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Id: default May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Name: Default May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Name: admin May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: method: > May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: exception: Flavor 42 could not be found. May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: action_args: {'id': '42'} May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:00.697104 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:00.698132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:00.699375 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-33d321e4-072a-497c-ae69-1d11a3558480 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:00.700403 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-33d321e4-072a-497c-ae69-1d11a3558480 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061300 May 11 05:51:00.700403 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 05:51:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:00.706587 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-95d75257-1346-40b2-a55d-348b3764ac46 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:00.727510 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-95d75257-1346-40b2-a55d-348b3764ac46 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024468 May 11 05:51:00.728053 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:51:00.737825 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-d484e2c0-a03b-499f-9997-02118cabf008 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:00.759103 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-d484e2c0-a03b-499f-9997-02118cabf008 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024808 May 11 05:51:00.759634 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:51:00.768956 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b1d8192a-8577-43ac-bf49-7c7164a497b2 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:00.774663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-b1d8192a-8577-43ac-bf49-7c7164a497b2 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b1d8192a-8577-43ac-bf49-7c7164a497b2 admin admin] Request method failure captured: May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept: application/json May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept-Encoding: gzip, deflate May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Connection: keep-alive May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Content-Length: 0 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Host: 10.222.0.44 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-Api-Version: compute 2.90 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-System-Scope: None May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: User-Agent: python-novaclient May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Auth-Token: gAAAAABie07E7bm_dtDwgA10bBtL1kQNm_615M2nVeSXiy1MCHCCyWlu5LTIZhV1BC6bn67gWvdrjd2-1e5_78JPNeUYggPHjiQJmeVPqqiaC54vX9SI9oSUA9RmEpicM88sTVUzYcdxPZ2NrhqPFz9UCUn4wkF5sW4tmPBDyEevkegYd74M_Ds May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Id: None May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Name: None May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Identity-Status: Confirmed May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Is-Admin-Project: True May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Id: default May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Name: Default May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Name: admin May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Role: member,admin,reader May 11 05:51:00.778023 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Roles: member,admin,reader May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant: admin May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Name: admin May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User: admin May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Id: default May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Name: Default May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Name: admin May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: method: > May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: exception: Flavor 42 could not be found. May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: action_args: {'id': '42'} May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:00.779419 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:00.780260 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:00.781513 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b1d8192a-8577-43ac-bf49-7c7164a497b2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:00.782734 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b1d8192a-8577-43ac-bf49-7c7164a497b2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014013 May 11 05:51:00.782734 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 05:51:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:01.654462 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-d484e2c0-a03b-499f-9997-02118cabf008 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:01.655536 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-d484e2c0-a03b-499f-9997-02118cabf008 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 11 05:51:01.655947 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:01.841215 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-67adf9f6-be95-4bed-922d-f9c3121cbe50 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:01.846454 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-67adf9f6-be95-4bed-922d-f9c3121cbe50 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-67adf9f6-be95-4bed-922d-f9c3121cbe50 admin admin] Request method failure captured: May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept: application/json May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept-Encoding: gzip, deflate May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Connection: keep-alive May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Content-Length: 0 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Host: 10.222.0.44 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-Api-Version: compute 2.90 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-System-Scope: None May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: User-Agent: python-novaclient May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Auth-Token: gAAAAABie07FBvzGIARG-DBgmRfytL6svI8Z5cWJOvUOz2RZpJvnI3V4Y96ZdXbxCJ41nTm2rkNZ5TubY-aYkzbUR8JqvOTvqKEm6tAdvLwAa2mDLdutMfoXz_QdrL8VRc0JZNk4SuJgGZMDfWtnchDC-uZVLaBUFe96opv7xQq0eBFZl6pomF4 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Id: None May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Name: None May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Identity-Status: Confirmed May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Is-Admin-Project: True May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Id: default May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Name: Default May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Name: admin May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Role: member,admin,reader May 11 05:51:01.847898 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Roles: member,admin,reader May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant: admin May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Name: admin May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User: admin May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Id: default May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Name: Default May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Name: admin May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: method: > May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: exception: Flavor 84 could not be found. May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: action_args: {'id': '84'} May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:01.849515 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:01.851395 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:01.852681 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-67adf9f6-be95-4bed-922d-f9c3121cbe50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:01.853951 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-67adf9f6-be95-4bed-922d-f9c3121cbe50 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058171 May 11 05:51:01.853951 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 05:51:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:01.859614 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-9dd711be-c5d1-4218-8df6-42453f66c4f9 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:01.873171 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-9dd711be-c5d1-4218-8df6-42453f66c4f9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017157 May 11 05:51:01.873748 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:51:01.883459 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-3b27e3e5-f71c-4a8f-b932-dfb417d4628f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:01.897679 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-3b27e3e5-f71c-4a8f-b932-dfb417d4628f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017859 May 11 05:51:01.898227 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:51:01.907329 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-61bc40b7-1d1d-4b81-aac6-b9692fd34c35 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:01.913057 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-61bc40b7-1d1d-4b81-aac6-b9692fd34c35 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-61bc40b7-1d1d-4b81-aac6-b9692fd34c35 admin admin] Request method failure captured: May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept: application/json May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept-Encoding: gzip, deflate May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Connection: keep-alive May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Content-Length: 0 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Host: 10.222.0.44 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-Api-Version: compute 2.90 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-System-Scope: None May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: User-Agent: python-novaclient May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Auth-Token: gAAAAABie07FBvzGIARG-DBgmRfytL6svI8Z5cWJOvUOz2RZpJvnI3V4Y96ZdXbxCJ41nTm2rkNZ5TubY-aYkzbUR8JqvOTvqKEm6tAdvLwAa2mDLdutMfoXz_QdrL8VRc0JZNk4SuJgGZMDfWtnchDC-uZVLaBUFe96opv7xQq0eBFZl6pomF4 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Id: None May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Name: None May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Identity-Status: Confirmed May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Is-Admin-Project: True May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Id: default May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Name: Default May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Name: admin May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Role: member,admin,reader May 11 05:51:01.914595 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Roles: member,admin,reader May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant: admin May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Name: admin May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User: admin May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Id: default May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Name: Default May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Name: admin May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: method: > May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: exception: Flavor 84 could not be found. May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: action_args: {'id': '84'} May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:01.916062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:01.917005 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:01.918371 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-61bc40b7-1d1d-4b81-aac6-b9692fd34c35 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:01.919673 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-61bc40b7-1d1d-4b81-aac6-b9692fd34c35 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012104 May 11 05:51:01.919673 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 05:51:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:02.797988 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-3b27e3e5-f71c-4a8f-b932-dfb417d4628f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:02.799011 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-3b27e3e5-f71c-4a8f-b932-dfb417d4628f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 11 05:51:02.799402 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:02.987006 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-fdccc19a-82db-43e3-8aae-03084fe15aca admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:02.993874 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.wsgi [None req-fdccc19a-82db-43e3-8aae-03084fe15aca admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-fdccc19a-82db-43e3-8aae-03084fe15aca admin admin] Request method failure captured: May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept: application/json May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Accept-Encoding: gzip, deflate May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Connection: keep-alive May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Content-Length: 0 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Host: 10.222.0.44 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-Api-Version: compute 2.90 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Openstack-System-Scope: None May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: User-Agent: python-novaclient May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Auth-Token: gAAAAABie07GiIv-xCJYLVY2Z-iF8-avbFBhIb7lJMG30Y2or_gsKTdclhZKXDvvWPRUpOXSGTmHU2Nbs5nBD3bTZCuozVvJ5DIZd6j1kGoJ2buI7-IxmoAeM2g40psnGmj-6yyC7peX0m7MxocoJjRfYzltx7FrQwwN6y3ZJokSIJUzf4KmpoY May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Id: None May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Domain-Name: None May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Identity-Status: Confirmed May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Is-Admin-Project: True May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Id: default May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Domain-Name: Default May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Project-Name: admin May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Role: member,admin,reader May 11 05:51:02.995372 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Roles: member,admin,reader May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant: admin May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-Tenant-Name: admin May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User: admin May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Id: default May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Domain-Name: Default May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: X-User-Name: admin May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: method: > May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: exception: Flavor 451 could not be found. May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: action_args: {'id': '451'} May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:02.996893 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:02.997897 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: ERROR nova.api.openstack.wsgi May 11 05:51:02.999117 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-fdccc19a-82db-43e3-8aae-03084fe15aca admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102779) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:03.000334 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-fdccc19a-82db-43e3-8aae-03084fe15aca admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060717 May 11 05:51:03.000334 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:51:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:03.007385 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-7f7f324b-9859-4228-9268-91c01232b19f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:03.020872 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-7f7f324b-9859-4228-9268-91c01232b19f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017713 May 11 05:51:03.021399 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:51:03.030810 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:03.044472 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017123 May 11 05:51:03.044994 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 05:51:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:51:03.054854 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bba998ac-c0f9-4d5a-be58-48c449001d39 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:03.059960 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.wsgi [None req-bba998ac-c0f9-4d5a-be58-48c449001d39 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bba998ac-c0f9-4d5a-be58-48c449001d39 admin admin] Request method failure captured: May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept: application/json May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Accept-Encoding: gzip, deflate May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Connection: keep-alive May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Content-Length: 0 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Host: 10.222.0.44 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-Api-Version: compute 2.90 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Openstack-System-Scope: None May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: User-Agent: python-novaclient May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Auth-Token: gAAAAABie07GiIv-xCJYLVY2Z-iF8-avbFBhIb7lJMG30Y2or_gsKTdclhZKXDvvWPRUpOXSGTmHU2Nbs5nBD3bTZCuozVvJ5DIZd6j1kGoJ2buI7-IxmoAeM2g40psnGmj-6yyC7peX0m7MxocoJjRfYzltx7FrQwwN6y3ZJokSIJUzf4KmpoY May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Id: None May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Domain-Name: None May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Identity-Status: Confirmed May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Is-Admin-Project: True May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Openstack-Nova-Api-Version: 2.90 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Id: default May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Domain-Name: Default May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Project-Name: admin May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Role: member,admin,reader May 11 05:51:03.061439 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Roles: member,admin,reader May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/092ac42400414e84802b398999ca7422"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_092ac42400414e84802b398999ca7422"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/092ac42400414e84802b398999ca7422"}]}] May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant: admin May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Id: 092ac42400414e84802b398999ca7422 May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-Tenant-Name: admin May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User: admin May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Id: default May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Domain-Name: Default May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Id: f9be91d729474890b96917c482066429 May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: X-User-Name: admin May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: method: > May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: exception: Flavor 451 could not be found. May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: action_args: {'id': '451'} May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:51:03.062952 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:03.063887 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: ERROR nova.api.openstack.wsgi May 11 05:51:03.064938 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-bba998ac-c0f9-4d5a-be58-48c449001d39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102780) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:51:03.065961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-bba998ac-c0f9-4d5a-be58-48c449001d39 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012128 May 11 05:51:03.065961 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:51:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 05:51:03.948555 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:03.949612 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 11 05:51:03.950019 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:04.139808 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-8e776e7b-87e1-425b-a08f-de5f66b3833d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:51:04.163100 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-8e776e7b-87e1-425b-a08f-de5f66b3833d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074143 May 11 05:51:04.163653 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 05:51:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:51:05.046962 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:05.047957 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 11 05:51:05.048356 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:05.234699 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ce59de82-a0bc-4019-a665-a542e8268914 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:51:05.251946 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ce59de82-a0bc-4019-a665-a542e8268914 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067636 May 11 05:51:05.252482 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 05:51:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:51:06.137016 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:06.138311 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 11 05:51:06.138708 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:06.326525 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-cc7630da-ee35-4f88-81df-185535d2a644 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:51:06.344367 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-cc7630da-ee35-4f88-81df-185535d2a644 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068249 May 11 05:51:06.344899 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 05:51:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:51:07.224476 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:07.226662 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002587 May 11 05:51:07.227103 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:07.414379 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-9bf6a841-2ea0-4097-b50e-06cfd9a9eeee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:51:07.432015 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-9bf6a841-2ea0-4097-b50e-06cfd9a9eeee admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068504 May 11 05:51:07.432568 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 05:51:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 05:51:08.324406 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:08.325490 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 11 05:51:08.325922 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:51:08.525970 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-393ad83f-7b13-4df8-a1c8-d95340a5c732 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:51:08.545204 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-393ad83f-7b13-4df8-a1c8-d95340a5c732 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070134 May 11 05:51:08.545778 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Wed May 11 05:51:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:52:10.383016 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.384062 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-c7269160-a4d6-440e-81c6-ec83c0e58147 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 11 05:52:10.384471 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:52:10.441163 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-c85051a6-8bdf-472e-ac25-49eb8f307694 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.460324 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-c85051a6-8bdf-472e-ac25-49eb8f307694 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069617 May 11 05:52:10.460860 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:52:10.483859 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-3cde4f05-907d-4e20-afd8-9016d5962f2c admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.492132 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-3cde4f05-907d-4e20-afd8-9016d5962f2c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012502 May 11 05:52:10.492652 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:52:10.503631 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-23380ef0-60b7-45b2-bcb8-a89852129f3f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.511233 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-23380ef0-60b7-45b2-bcb8-a89852129f3f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011154 May 11 05:52:10.511744 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:52:10.523069 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.530308 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011054 May 11 05:52:10.530821 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:52:10.542303 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-f98311fd-9c2c-402a-ae04-70f6a55b31d1 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:52:10.549889 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-f98311fd-9c2c-402a-ae04-70f6a55b31d1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011026 May 11 05:52:10.550410 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Wed May 11 05:52:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:55:42.806408 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:42.807419 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 11 05:55:42.807820 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:55:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:55:43.071369 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:43.072531 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:55:43.072531 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:55:43.073795 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:43.074231 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:43.075011 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:43.075435 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:43.109337 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-1adadeac-8b59-4da8-b71b-bba6fd85aedb admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.147557 May 11 05:55:43.109945 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:55:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:55:44.008683 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:44.009737 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 11 05:55:44.010139 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:55:44.204408 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:44.205649 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:55:44.205649 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:55:44.206822 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:44.207262 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:44.208043 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:44.208469 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:44.227601 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-b79d401a-82c8-4a8c-badf-ae29f60eefd5 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075072 May 11 05:55:44.228085 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:55:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:55:55.629910 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:55.630922 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 11 05:55:55.631322 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:55:55.822711 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:55.823899 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:55:55.823899 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:55:55.825071 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:55.825538 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:55.826321 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:55.826746 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:55.852904 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-0dba8ab5-1e27-440a-aeba-8353d601e398 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080626 May 11 05:55:55.853581 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:55:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:55:56.748367 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: DEBUG nova.api.openstack.wsgi [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] Calling method '>' {{(pid=102779) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:56.749367 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: INFO nova.api.openstack.requestlog [None req-e2848be1-51e8-4925-a6fe-29822f7f1c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 11 05:55:56.749794 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: [pid: 102779|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 05:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:55:56.941742 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG nova.api.openstack.wsgi [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] Calling method '>' {{(pid=102780) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:55:56.942903 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 05:55:56.942903 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: warnings.warn(msg) May 11 05:55:56.944070 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:56.944556 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:56.945329 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:55:56.945784 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: DEBUG oslo_concurrency.lockutils [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102780) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:55:56.966976 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: INFO nova.api.openstack.requestlog [None req-ad7a6625-8841-4d3b-865e-20d9a575d92f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.074785 May 11 05:55:56.967442 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: [pid: 102780|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 05:55:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:56:56.603867 dv-cinder-733623-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 05:56:56.604716 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: Wed May 11 05:56:56 2022 - graceful shutdown triggered... May 11 05:56:56.605256 dv-cinder-733623-13-iscsi devstack@n-api.service[102779]: Gracefully killing worker 1 (pid: 102779)... May 11 05:56:56.605663 dv-cinder-733623-13-iscsi devstack@n-api.service[102780]: Gracefully killing worker 2 (pid: 102780)... May 11 05:56:57.605849 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: worker 1 buried after 1 seconds May 11 05:56:57.605849 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: worker 2 buried after 1 seconds May 11 05:56:57.605849 dv-cinder-733623-13-iscsi devstack@n-api.service[102778]: goodbye to uWSGI. May 11 05:56:57.607444 dv-cinder-733623-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 05:56:57.608005 dv-cinder-733623-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 05:56:57.610705 dv-cinder-733623-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 05:56:57.624919 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 05:56:57 2022] *** May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: nodename: dv-cinder-733623-13-iscsi May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: machine: x86_64 May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: clock source: unix May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: pcre jit disabled May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: detected number of CPU cores: 4 May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: current working directory: / May 11 05:56:57.638558 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: detected binary path: /usr/bin/uwsgi-core May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: your processes number limit is 47680 May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: your memory page size is 4096 bytes May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: detected max file descriptor number: 2048 May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: lock engine: pthread robust mutexes May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: thunder lock: enabled May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 05:56:57.639357 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 05:56:57.688447 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: Python main interpreter initialized at 0x5610558ed9c0 May 11 05:56:57.688447 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: python threads support enabled May 11 05:56:57.688447 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: your server socket listen backlog is limited to 100 connections May 11 05:56:57.688447 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: your mercy for graceful operations on workers is 90 seconds May 11 05:56:57.688903 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: mapped 403077 bytes (393 KB) for 2 cores May 11 05:56:57.688903 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: *** Operational MODE: preforking *** May 11 05:56:57.689149 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: *** uWSGI is running in multiple interpreter mode *** May 11 05:56:57.689149 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: spawned uWSGI master process (pid: 117315) May 11 05:56:57.689356 dv-cinder-733623-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 05:56:57.689987 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: spawned uWSGI worker 1 (pid: 117334, cores: 1) May 11 05:56:57.691799 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: spawned uWSGI worker 2 (pid: 117335, cores: 1) May 11 05:56:57.691799 dv-cinder-733623-13-iscsi devstack@n-api.service[117315]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 05:56:58.907526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 05:56:58.952391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 05:56:59.710671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:56:59.710671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: from cryptography.utils import int_from_bytes May 11 05:56:59.711001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:56:59.711001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: from cryptography.utils import int_from_bytes May 11 05:56:59.787444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:56:59.787444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: from cryptography.utils import int_from_bytes May 11 05:56:59.787775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 05:56:59.787775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: from cryptography.utils import int_from_bytes May 11 05:57:02.152690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:57:02.153307 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:57:02.153600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:57:02.153970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:57:02.154231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:57:02.154622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.154957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.155309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.155635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.155971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.156286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.156613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.156938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.157269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.157563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.157884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.158214 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733623-13-iscsi {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.158543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.158859 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.159182 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.160190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.160491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.160819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.161185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.161661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.162108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.162422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.162740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.163080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.163403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.163720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.164046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.164362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.164694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.165010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.165413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733623-13-iscsi {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.165758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.166078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.166397 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.166815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.167174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.167474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.167799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.168124 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.168455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.168768 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.169089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.169417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.169769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.170075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.170388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.170708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.171029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.171340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.171651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.171906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.172226 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.172574 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.172908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.173239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.173513 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.173774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.174100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.174426 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.174744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.175652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.175992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.176874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.176874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.177060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.177366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.177713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.178059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.178369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.178701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.179019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.179350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.179757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.180018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.180337 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.181663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.181663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.181663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.181663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.181977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.182257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.182573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.182888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.183215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.183543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.183852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.184108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.184426 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.184729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.185053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.185370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.185701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.186227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.186717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.187216 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.187557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.187864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.188180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.188497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.189210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.189210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.189420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.189838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.190170 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.190498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.190840 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.191153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.191466 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.191777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.192102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.192415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.192727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.193055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.193365 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.193699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.194027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.194342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.194655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.194980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.195287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.195600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.195928 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.196242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.196552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.196864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.197173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.197529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.197812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.198121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.198430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.198736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.199060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.199392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.199705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.200016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.200326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.200650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.200993 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.201327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.201693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.202014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.202349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.202685 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.203007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.203323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.203643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.203973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.204286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.204600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.204914 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.205238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.205586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.205923 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.206265 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.206587 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.206909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.207228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.207550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.207883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.208209 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.208525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.208869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.209225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.209563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.209895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.210223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.210540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.210855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.211171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.211531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.211881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.212177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.212495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.212845 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.213141 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.213453 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.213793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.214110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.214451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.214770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.215088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.215406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.215726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.216046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.216358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.216673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.216982 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.217291 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.217621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.217934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.218242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.218567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.218898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.219228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.219599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.219872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.220200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.220570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.220828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.221151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.221569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.222342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.222662 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.222990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.223303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.223612 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.223943 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.224265 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.224587 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.224902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.225219 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.225552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.225881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.226198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.226534 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.226849 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.227164 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.227503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.227839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.228156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.228481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.228821 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.229141 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.229454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.229791 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.230111 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.230440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.230733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.231085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.231428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.231720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.232031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.232349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.232658 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.233017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.233318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.233649 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.233959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.234268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.234614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.234921 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.235264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.235604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.235926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.236256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.236575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.236892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.237204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.238095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.238423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.238864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.239113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.239430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.239760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.240095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.240403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.240719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.241045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.241355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.241695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.242041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.242374 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.242694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.243020 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.243336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.243653 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.243964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.244279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.244595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.244909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.245230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.245566 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.245889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.246201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.246528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.246839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.247160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.247468 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.247783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.248109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.248441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.248752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.249066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.249388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.249729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.250043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.250355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.250664 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.250970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.251279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.251657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.251903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.252212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.252520 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.252833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.253251 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.253608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.253916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.254230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.254555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.254870 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.255209 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.255519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.255826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.256134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.256462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.256781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.257100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.257408 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.257741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.258088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.258403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.258712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.259031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.259356 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.259683 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.259999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.260528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.260829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.261173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.261533 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.261831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.262150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.262469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.262784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.263101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.263430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.263750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.264065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.264381 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.264692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.265006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.265328 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.266216 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.266555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.266879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.267218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.267537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.267859 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.268197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.268532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.269391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.269732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.270055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.270375 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.270682 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.270999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.271311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.271621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.271933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.272245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.272555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.272863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.273171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.273502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.273816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.274123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.274439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.274748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.275074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.275385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.275693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.275998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.276304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.276646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.276958 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.277298 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.277678 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.278024 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.278336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.278645 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.278971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.279280 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.279588 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.279902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.280212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.280522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.280826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.281139 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.281452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.281786 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.282098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.282406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.282717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.283023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.283339 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.283649 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.283956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.284261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.285167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.285453 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.285748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.286579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.286579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.286910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.287227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.287548 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.287855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.288169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.288482 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.288790 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.289116 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.289429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.290193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.290193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.290363 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.293596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.294144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.294383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.294962 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.295554 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.296134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.296721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.297321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.297936 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.298524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.299155 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.299759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.300378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.300988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.301593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.302241 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.302834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.303606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.304094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.304700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.305297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.312524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.313088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 05:57:02.314824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.314902 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 05:57:02.314995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 05:57:02.315150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 05:57:02.315319 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 05:57:02.315463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.315668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.315912 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.315983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.316066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.316152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.316231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.316231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.316854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.317020 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.317168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.317322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.317509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.317661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.317661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.317948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.318093 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.318252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.318252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.318533 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.318685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.318828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.318986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733623-13-iscsi {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.319138 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.319301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.319445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.319589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.319739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.319892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.320044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.320196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.320339 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.320490 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.320635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.320787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.320930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.321073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.321233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.321386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.321613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.321867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.322016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.322158 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.322301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.322443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.322596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.322749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.322901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.323066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.323213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.323364 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.324249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.324407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.324552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.324706 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.324853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.325007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.325152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.325294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.325437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.325620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.325788 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733623-13-iscsi {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.325942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.326097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.326241 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.326385 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.326528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.326686 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.326838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.326991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.327144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.327298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.327461 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.328226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.328392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.328537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.328681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.328886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.329052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.329198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.329350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.329535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.329695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.329840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.329998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.330152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.330315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.330517 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.330667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.330822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.330975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.331133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.331856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.332003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.332146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.332301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.332459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.332604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.332754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.332918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.333062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.333219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.333371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.333371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.334127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.334519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.334674 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.334828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.334981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.335125 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.335269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.335436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.335596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.335751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.335905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.336051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.336193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.336346 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.336516 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.336670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.336823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.336974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.337117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.337270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.337425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.337646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.337793 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.337935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.338086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.338236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.338389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.338541 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.338686 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.338828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.338979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.339135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.339297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.339450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.339594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.339735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.339886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.340043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.340188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.340330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.340330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.340612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.340756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.340918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.341072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.341224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.341368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.341540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.341700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.341855 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.341999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.342142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.342291 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.342433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.342589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.342744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.342887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.343043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.343197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.343348 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.343506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.343658 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.344197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.344351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.344758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.344903 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.345061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.345207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.345553 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.345711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.345879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.346026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.346179 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.346340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.346340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.346651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.346651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.347532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.347532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.347833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.347833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.348166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.348310 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.348478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.348631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.348782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.348936 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.349089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.349242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.349395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.349563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.349720 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.349872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.350017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.350167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.350330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.350476 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.350476 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.350764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.350908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.351067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.351221 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.351372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.351515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.351822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.351966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.352170 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.352331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.352495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.352647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.352797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.352940 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.353094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.353275 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.353439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.353624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.353854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.354435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.354851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.355017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.355163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.355369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.355527 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.355671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.355813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.355963 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.356115 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.356279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.356435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.356586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.356737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.356900 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.357064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.357216 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.357373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.357535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.357695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.357848 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.358003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.358147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.358298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.358450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.358602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.358753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.358906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.359050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.359211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.359355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.359500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.359652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.359796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.359796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.360068 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.360212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.360512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.360664 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.360808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.360958 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.361121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.361274 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.361429 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.361598 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.361742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.361884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.362028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.362170 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.362326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.363018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.363185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.363404 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.363556 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 05:57:02.363727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.363884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.364440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.364599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365167 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.365991 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366319 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366484 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.366925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367234 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367234 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.367961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368285 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368716 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.368870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369022 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.369935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370539 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370698 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.370857 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371484 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.371961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.372234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.372402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.372569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.372764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.372930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.373894 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.374046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.374693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.374884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.375247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.375501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.375659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.375818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.375977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376607 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376756 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.376904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377385 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.377999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.378744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.378911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.379859 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380011 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380325 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380477 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.380945 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.381983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382458 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382612 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.382911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.383977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.384126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.384691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.384932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.385281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.385451 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.385748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.385916 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386068 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386394 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.386708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387321 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387794 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.387953 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.388888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389037 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.389948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.390104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.390255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.390414 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.390574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.390980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.391151 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.391375 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.391533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.391691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.391856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.392926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.393937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.394129 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.394282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.394829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.395096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.395283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.395620 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.395779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.395942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.396101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.396270 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.396434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.396587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.396869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.397850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398002 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398404 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.398871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399022 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399494 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.399952 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400698 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.400856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401525 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401683 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.401998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.402787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.403549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.404079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.404266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.404421 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.404602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.405087 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.405316 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.405528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.405847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406645 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.406796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.407975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.408927 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.409088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.409239 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.409657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.409828 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.409980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410452 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410771 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.410930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411736 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.411899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.412952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413668 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413823 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.413983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.414280 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.414442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.414593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.414743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.415231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.415231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.415638 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.415994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416489 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.416963 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.417221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.417380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.417567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.417725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.417884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.418994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.419947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420265 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420418 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420576 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.420893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421773 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.421928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422243 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422243 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422544 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.422997 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.423924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424235 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.424861 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.426307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.426496 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.426663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.426833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.426998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.427160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.427412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.427412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.427745 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.427745 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.428824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429035 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429527 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.429865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430024 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.430969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.431282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.431434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.431594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.431594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.431892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432820 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.432979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433813 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.433983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.434757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.435061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.435210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.435370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.435544 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.436015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.436400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.436562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.436713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.436885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.437947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.438893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.439992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.440153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.440295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.440440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.440668 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.441415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.442730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.443251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.443251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.443251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.443448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.443723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.444047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.444366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.444682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.445003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.445323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.447180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.448190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.448190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.448190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.448633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.448793 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.449034 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.449346 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.449685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.450003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.450313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.450627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.450944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.451275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.451634 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.451908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.452225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.452546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.452858 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.453171 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.453501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.453816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.454127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.454438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.454748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.455081 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.455495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.455822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.456220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.457825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.458053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.458302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.458616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.459006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.459304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.459631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.459961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.460287 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.460604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.460926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.461241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.461599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.461922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.462107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_db.sqlalchemy.engines [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.462269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.462544 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.462863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.463200 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.463523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.463942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.464172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.464614 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.464832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.465150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.465465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.465813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.466161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.466497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.466738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.467083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.467986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.467986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.467986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.468494 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.468798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.468969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.469237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.469532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.469867 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.470184 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.470499 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.470815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.471128 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.471447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.471763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.473361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.473792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.474122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.474442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.474767 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.475093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.475421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.475748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.476063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.476495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.476821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.477195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.477457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.480805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482896 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.482896 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.483195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.483343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.483572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.483886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.484209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.484528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.484861 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.485192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.486068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.486068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.486413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.486574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.486799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.487120 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.487481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.488410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.488754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.489085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.489428 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.489798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.490120 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.490442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.490769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.491089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.491408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.491744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.492062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.492385 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.492708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.493035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.493351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.494147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.494147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.494444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.494636 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.494961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.495297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.495692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.495985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.496275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.496597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.496915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.497230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.497575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.497930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.498652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.498652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.498975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.499209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.499530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.499873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.500208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.500533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.500860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.501192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.501527 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.501842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.502160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.502475 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.502795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.503228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.504166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.504463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.504782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.505098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.505433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.506018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.506205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.506489 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.506803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.507128 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.507437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.507787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.508101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.508449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.509228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.509228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.509549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.509782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.510076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.510405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.510730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.511054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.511378 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.511703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.512028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.512352 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.512671 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.513002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.513324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.513678 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.514254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.514593 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.514918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.515240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.515559 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.516149 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.516471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.516792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.517112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.517430 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.517777 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.518115 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.518448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.519334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.520238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.520572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.520901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.521231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.521585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.521959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.522286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.522606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.522930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.523255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.523587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.523912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.524233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.524556 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.524879 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.525201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.525541 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.525866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.526191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.526525 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.526869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.527198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.527521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.527842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.528170 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.528704 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.529027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.529371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.529541 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.context [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),890801eb-2d5b-42d0-96a3-e70da598d966(cell1) {{(pid=117334) load_cells /opt/stack/nova/nova/context.py:464}} May 11 05:57:02.529730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.530061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.530389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.530716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.531054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.531372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.531687 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.532005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.532324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.532632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.532983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.533282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.533622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.533900 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:02.534038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.534257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.536006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.536131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:02.536379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.536719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.536917 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:02.537048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.537392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.537773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.538104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.538476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.538884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.539082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:02.539427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.539427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.540066 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.540066 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.540717 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.540717 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.541041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.541192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.541537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.541852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.542290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.542616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.542933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.543250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.543580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.543896 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.544209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.544588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.544916 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.545241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.545590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.545913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.546228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.546550 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.546978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.547179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.547564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.547902 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.548218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.548566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.548931 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.549175 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.549524 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.550036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.550391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.550913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_db.sqlalchemy.engines [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.551208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.551735 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.552148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.552498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.552836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.553190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.553542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_db.sqlalchemy.engines [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.553644 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.553877 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.554197 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.554519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.554856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.555178 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.555500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.555821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.556142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.556463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.556784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.557103 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.557420 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.557767 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.558086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.558403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.558726 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.559182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.559456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.559705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.560036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.560361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.560688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.561008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.561326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.561669 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.561997 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.562322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.562661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.562986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.563300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.563740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.564061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.564389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.564719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.565036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.565364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.566244 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.566642 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.566979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.567303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.567647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.567994 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.568384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.568714 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.569014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.569295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.569623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.569946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.570396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.570570 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.570881 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.571198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.571513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.571827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.572163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.572450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.572763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.573077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.573391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.573733 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.574045 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.574356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.574667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.574979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.575294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.575605 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.575916 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.576227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.576538 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.576848 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.577188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.577552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.577878 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.578208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.578529 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.578859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.579173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.579503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.579831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.580157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.580473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.580814 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.581131 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.582210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.582633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.582962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.583288 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.583616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.583956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.584295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.584613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.584949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.585277 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.585635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.585958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.586280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.586617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.586940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.587260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.587583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.587904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.588224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.588548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.588871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.589206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.589592 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.589895 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.590230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.590586 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.590907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.591259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.591596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.591920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.592263 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.592560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 05:57:02.592809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 05:57:02.617601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.684459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.context [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),890801eb-2d5b-42d0-96a3-e70da598d966(cell1) {{(pid=117335) load_cells /opt/stack/nova/nova/context.py:464}} May 11 05:57:02.688882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:02.690505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:02.692354 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:02.694344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:02.705761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.709343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.717144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_db.sqlalchemy.engines [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:02.877291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_db.sqlalchemy.engines [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 05:57:03.036871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: WARNING keystonemiddleware.auth_token [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:57:03.044411 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: WARNING keystonemiddleware.auth_token [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:57:03.207880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: WARNING keystonemiddleware.auth_token [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:57:03.215645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: WARNING keystonemiddleware.auth_token [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:57:03.391107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: WARNING keystonemiddleware.auth_token [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:57:03.398179 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: WARNING keystonemiddleware.auth_token [None req-9683f51e-dca5-4d62-b13d-28825ef70740 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:57:03.403506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610558ed9c0 pid: 117334 (default app) May 11 05:57:03.558871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: WARNING keystonemiddleware.auth_token [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 05:57:03.565195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: WARNING keystonemiddleware.auth_token [None req-6f8d6c20-3bea-4b22-8c71-2a464cc9490a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 05:57:03.571167 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5610558ed9c0 pid: 117335 (default app) May 11 05:57:46.696617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a2002438-ead3-4784-9cff-0de2201de45b tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa141032160>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:47.475323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a2002438-ead3-4784-9cff-0de2201de45b tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6848389c-6bbc-4d91-b54a-0218c694624e" status: 200 len: 351 microversion: 2.1 time: 1.257275 May 11 05:57:47.475903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 1/1] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 05:57:46 2022] GET /compute/v2.1/os-volumes/6848389c-6bbc-4d91-b54a-0218c694624e => generated 351 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:57:48.554015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-358097804", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "networks": [{"uuid": "9dfe63ce-f48f-4bae-96a9-e745ecfb0b0a"}]}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:57:49.176142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] validate_networks() for [('9dfe63ce-f48f-4bae-96a9-e745ecfb0b0a', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:57:49.331136 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8e1b7f1d-fafe-40ae-b6e0-c723863a244f tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140ef94c0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:49.434330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8e1b7f1d-fafe-40ae-b6e0-c723863a244f tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e147cce2-f1b0-4e97-b826-dcc82ae0a0d9" status: 200 len: 351 microversion: 2.1 time: 0.107537 May 11 05:57:49.435187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 05:57:49 2022] GET /compute/v2.1/os-volumes/e147cce2-f1b0-4e97-b826-dcc82ae0a0d9 => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:57:51.165268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8bfc6773-9057-47ee-9fd5-3aa57acd0cc4 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140ef9c10>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:51.289000 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8bfc6773-9057-47ee-9fd5-3aa57acd0cc4 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1360a770-e21c-42ec-8041-e5c51c8d3cb8" status: 200 len: 350 microversion: 2.1 time: 0.127220 May 11 05:57:51.290211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 3/3] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes/1360a770-e21c-42ec-8041-e5c51c8d3cb8 => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:57:51.303569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4df0cc4f-a8db-4cd1-88eb-50147ce768c9 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140ef9dc0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:51.484104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4df0cc4f-a8db-4cd1-88eb-50147ce768c9 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.186109 May 11 05:57:51.484857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1133 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:57:51.502613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-31618492-65ee-489d-98ec-52ace9ead3c8 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140e3c0d0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:51.662885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-31618492-65ee-489d-98ec-52ace9ead3c8 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.167991 May 11 05:57:51.664096 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1148 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:57:51.678033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d150e4dd-ad8e-4998-8490-7bd6505c563b tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140ef9430>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:51.794470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d150e4dd-ad8e-4998-8490-7bd6505c563b tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.122291 May 11 05:57:51.795151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 6/6] 10.222.0.44 () {58 vars in 1133 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:57:51.809264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bb5928d6-ff3c-41d0-9ae8-b2e4a574e2cd tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140e3c9d0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:51.976327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bb5928d6-ff3c-41d0-9ae8-b2e4a574e2cd tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.171096 May 11 05:57:51.977774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 7/7] 10.222.0.44 () {58 vars in 1166 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:57:51.986925 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:57:51.988143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:57:51.988790 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:57:51.989335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:57:51.989957 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:57:51.992040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4b15bb3e-97ca-4fc5-b29d-c539b87a66a9 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140e3cdc0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:52.014582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:52.015037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:52.017969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:52.018514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:52.126081 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Getting quotas for project 98d1a529cc4d4a11b49d9e08ae5b2f69. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:57:52.142680 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Getting quotas for user 9fdceba628fb45b0a7d42547cd1c0f4f and project 98d1a529cc4d4a11b49d9e08ae5b2f69. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:57:52.174645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:57:52.178215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4b15bb3e-97ca-4fc5-b29d-c539b87a66a9 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.192094 May 11 05:57:52.178804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 8/8] 10.222.0.44 () {58 vars in 1169 bytes} [Wed May 11 05:57:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:57:52.192047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fce014a4-cc67-4edf-831c-32c8a9dad08e tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140e3cb80>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:52.198864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:57:52.403563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fce014a4-cc67-4edf-831c-32c8a9dad08e tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.197728 May 11 05:57:52.403563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 9/9] 10.222.0.44 () {58 vars in 1154 bytes} [Wed May 11 05:57:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:57:52.408834 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-240fb62a-c4f5-4b0d-8569-dec111705cd3 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.320439 May 11 05:57:52.409572 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-38b833a4-44c2-40b8-a686-48f313f4f3b8 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140ef9d30>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:52.415718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 1/10] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 4330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:57:52.421180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-49cb3e69-7455-4668-842f-eb928b180d0f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:52.421813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-49cb3e69-7455-4668-842f-eb928b180d0f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:57:52.702787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-38b833a4-44c2-40b8-a686-48f313f4f3b8 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.302423 May 11 05:57:52.703362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 10/11] 10.222.0.44 () {58 vars in 1187 bytes} [Wed May 11 05:57:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:57:52.716501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9b66e4da-24a8-424c-8bd7-7e04ffbcb083 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] Calling method '.version_select at 0x7fa140f3f790>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:52.800261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-49cb3e69-7455-4668-842f-eb928b180d0f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:57:52.840445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-49cb3e69-7455-4668-842f-eb928b180d0f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1214 microversion: 2.1 time: 0.422744 May 11 05:57:52.849979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 2/12] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:57:52 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1214 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:57:52.970872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9b66e4da-24a8-424c-8bd7-7e04ffbcb083 tempest-VolumesTestJSON-1210108078 tempest-VolumesTestJSON-1210108078-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.258890 May 11 05:57:52.971755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 11/13] 10.222.0.44 () {58 vars in 1154 bytes} [Wed May 11 05:57:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:57:53.860443 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2a6e7a9c-150e-4edb-9c94-cbf7ccb91338 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:53.862439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2a6e7a9c-150e-4edb-9c94-cbf7ccb91338 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:57:54.786700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2a6e7a9c-150e-4edb-9c94-cbf7ccb91338 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:57:54.794037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2a6e7a9c-150e-4edb-9c94-cbf7ccb91338 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1214 microversion: 2.1 time: 0.937465 May 11 05:57:54.794614 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 3/14] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:57:53 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1214 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:57:55.817770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:55.818650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:57:55.868230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:55.868694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:55.875604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:55.880055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:56.930755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:57:56.963191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-be1b0d1b-d305-4623-b994-bfcdbfc7e582 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1272 microversion: 2.1 time: 1.147380 May 11 05:57:56.965309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 12/15] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:57:55 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1272 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:57:57.983322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:57.983973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:57:58.007125 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:58.009240 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:58.012764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:58.013889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:58.201534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8915f0f3-60fa-429d-b26a-14e6c2db18a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: .version_select at 0x7fa1405844c0>, body: {"keypair": {"name": "tempest-keypair-380720542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAMJsL/phG1PptTyhfdR2ZCFIN+xTQFPbMy9P7sIpK4scrGPvec9ijk6G7OmitsA6VPo/6aDq9IA0iNSkrA5XmMrC4dap7o/fjXYbs15aI7biy5QPOQqdc4uGSvL3kjjJg=="}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:57:58.256051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-8915f0f3-60fa-429d-b26a-14e6c2db18a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:57:58.266128 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-8915f0f3-60fa-429d-b26a-14e6c2db18a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for user 8396cfed6d904f859ade91e210c619b5 and project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:57:58.355922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8915f0f3-60fa-429d-b26a-14e6c2db18a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.484226 May 11 05:57:58.363349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 4/16] 10.222.0.44 () {62 vars in 1199 bytes} [Wed May 11 05:57:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 487 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 05:57:58.622918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:57:58.631382 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-94b251c2-e43c-4d24-bf18-27965cd2dcce tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1272 microversion: 2.1 time: 0.652062 May 11 05:57:58.640378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 13/17] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:57:57 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1272 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:57:59.654740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:57:59.655666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:57:59.683600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:59.684187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:57:59.687055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:57:59.690671 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:02.490193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:02.518558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-191e870f-8fe8-4501-af89-6669b4e55937 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 2.863846 May 11 05:58:02.534957 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 5/18] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:57:59 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:03.540818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:03.544049 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:03.577385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:03.583116 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:03.588443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:03.588988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:05.356535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:05.366913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8c737d6e-9131-43f5-8203-50c5cbb7676d tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 1.832615 May 11 05:58:05.366913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 14/19] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:03 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:06.395091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:06.395834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:06.419335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-53e353fb-fd28-4b27-936d-548a6fbf2d40 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: .version_select at 0x7fa1404eeee0>, body: {"keypair": {"name": "tempest-keypair-897640579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcErWM8zMJhSFKwLmLcHiEPWTw7oBLAHmVirKYFvK3i0Y0U4ILQYzSaTve99UDG9BTn275ZLopBoBXCsxZrFTT2LLPVNQOQi9kC1R8LiQlYs9e0fXDctk//Hs3/js27Cw=="}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:06.437694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:06.441071 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:06.441990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:06.447215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:06.470073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-53e353fb-fd28-4b27-936d-548a6fbf2d40 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:06.491334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-53e353fb-fd28-4b27-936d-548a6fbf2d40 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:06.579695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-53e353fb-fd28-4b27-936d-548a6fbf2d40 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.936362 May 11 05:58:06.582430 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 6/20] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 05:58:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:08.389761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1315581232", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eec2f2f0-8c81-41fb-84f6-0e8c08e134ad"}], "security_groups": [{"name": "tempest-securitygroup--630609737"}], "key_name": "tempest-keypair-380720542", "user_data": "}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:08.734027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] validate_networks() for [('eec2f2f0-8c81-41fb-84f6-0e8c08e134ad', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:58:09.039463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:09.056264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7138a225-6fcc-48c4-aa70-c67277563ec9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 2.668579 May 11 05:58:09.059577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 15/21] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:06 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:09.757554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:58:09.758080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:58:09.758924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:58:09.760110 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:58:09.762057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:58:09.795887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:09.796479 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:09.804049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:09.806568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:09.901111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:09.918250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for user 8396cfed6d904f859ade91e210c619b5 and project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:09.958043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:58:09.979765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:58:10.077518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:10.080384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:10.098063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8b74b380-4446-4ed5-b703-1687da06e004 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.714150 May 11 05:58:10.101464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 7/22] 10.222.0.44 () {62 vars in 1187 bytes} [Wed May 11 05:58:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 05:58:10.119354 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:10.120163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:10.123258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:10.127483 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:10.132761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:10.135032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:10.368619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:10.381360 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:10.386950 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:10.404956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-158bbc3f-c747-401f-aca1-b529cb5af1c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1281 microversion: 2.20 time: 0.297185 May 11 05:58:10.406219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 8/23] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:10 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1281 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:11.544261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-6bda65ca-0e9f-408f-8d63-e57f80fde724 req-1783f7a6-9b41-44ea-8c8d-a647e8d05d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39347ca4-ad15-48cb-8486-41ea06de7fee", "tag": "a4a31f05-f49f-42aa-8746-ff5fe28d2566"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:11.593804 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-6bda65ca-0e9f-408f-8d63-e57f80fde724 req-1783f7a6-9b41-44ea-8c8d-a647e8d05d69 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:11.594986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-6bda65ca-0e9f-408f-8d63-e57f80fde724 req-1783f7a6-9b41-44ea-8c8d-a647e8d05d69 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:11.660433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-6bda65ca-0e9f-408f-8d63-e57f80fde724 req-1783f7a6-9b41-44ea-8c8d-a647e8d05d69 service nova] Creating event network-changed:a4a31f05-f49f-42aa-8746-ff5fe28d2566 for instance 39347ca4-ad15-48cb-8486-41ea06de7fee on hv-cinder-73362 May 11 05:58:11.660961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-6bda65ca-0e9f-408f-8d63-e57f80fde724 req-1783f7a6-9b41-44ea-8c8d-a647e8d05d69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117335) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 05:58:11.662334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:11.662618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:11.663382 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:11.678956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:11.716815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.compute.rpcapi [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 05:58:11.717750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] Releasing lock "compute-rpcapi-router" {{(pid=117335) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 05:58:11.765343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3403e4fe-c9c5-4f0e-b216-db7102dc47ac None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041467 May 11 05:58:11.767084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 9/24] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:58:11.778469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:11.783553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:11.990830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:11.999150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:12.009258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-94baf85c-388e-4824-9aaf-85a48904bb73 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 1.936609 May 11 05:58:12.012177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 16/25] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:10 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:12.041918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:12.044264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:12.047151 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-218f2fd2-4d31-4cd3-8965-a5653cf41058 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1281 microversion: 2.20 time: 0.277972 May 11 05:58:12.051522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 10/26] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:11 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:12.852738 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619975111", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dde216-4b2f-4353-ba38-412714627bb9"}], "security_groups": [{"name": "tempest-securitygroup--1502395343"}], "key_name": "tempest-keypair-897640579", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:13.030275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:13.032041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:13.041728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:13.042232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:13.046040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:13.049362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:13.310928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:13.320088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7b456257-55c1-4383-be98-b4973bea20c8 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.295198 May 11 05:58:13.326880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 11/27] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:13 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:13.349710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:13.352348 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:13.364383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:13.367044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:13.368681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:13.378293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:13.574106 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:13.595727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:13.600281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:13.606021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-07d8192c-2c73-4007-ad95-8b5db12a29a9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1351 microversion: 2.20 time: 0.277063 May 11 05:58:13.608890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 12/28] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:13 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1351 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:13.911439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] validate_networks() for [('28dde216-4b2f-4353-ba38-412714627bb9', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:58:14.341366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:14.353051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:14.375268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:14.386929 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:14.388732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:14.393661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:14.812841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:14.821728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ee2e1df6-0ec0-4633-acaa-5f3c267f0157 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.487976 May 11 05:58:14.825126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:14 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:14.833745 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:14.834502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:14.855806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:14.856951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:14.859975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:14.865505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:15.069513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:15.093092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:15.104580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:15.106021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-733d0c88-9f15-47a0-84ed-d3e98f702836 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1339 microversion: 2.20 time: 0.277971 May 11 05:58:15.114572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 14/30] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:14 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:15.555725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fea62010-29e8-400b-9ecc-8c398f6adc6e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: .version_select at 0x7fa140489700>, body: {"keypair": {"name": "tempest-keypair-178086888", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuriBd3gdA+q/NG4Y2Tr46UK+lFuJ4iSv2mPIpjbP6+cYp/BQQWnYy11tpE5+Bs8sQj1u5QKTfX/gsTflJko6dWt8QjqPUUZ7KCkRjA/FSa0m7V/ThHVGHwbKoJCVKlXw=="}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:15.594038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-fea62010-29e8-400b-9ecc-8c398f6adc6e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:15.608155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-fea62010-29e8-400b-9ecc-8c398f6adc6e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for user aa2d83bcc02a43f89ba4785a9bdedd15 and project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:15.676180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fea62010-29e8-400b-9ecc-8c398f6adc6e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.559593 May 11 05:58:15.679372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 15/31] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 05:58:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:15.943373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-113696431", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:16.081151 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] validate_networks() for [('b62a26f9-5853-46d1-925a-762af9a689ba', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:58:16.311143 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:58:16.311719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:58:16.312368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:58:16.314486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:58:16.315151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:58:16.361915 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:16.362547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:16.370026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:16.371114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:16.460436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:16.481569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:16.515655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:58:16.527580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:58:16.696513 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fe6798c7-67e5-437a-a071-5173a1243113 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.841555 May 11 05:58:16.697856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 17/32] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:58:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 3850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:58:16.716712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:16.723407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:16.740287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:16.741270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:16.743024 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:16.745623 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:17.793432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:58:17.794645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:58:17.795460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:58:17.796135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:58:17.796891 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:58:17.815307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:17.815546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:17.818126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:17.823022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:17.823907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:17.827416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-26772650-9226-4c0b-a03e-71b9c6d0d80f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 1.127921 May 11 05:58:17.835387 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 18/33] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:16 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:17.864221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:17.865902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:17.866857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:17.888853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for user 28c76d12b0b1436d8eb0b23acf252f25 and project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:17.893323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:17.896173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:17.899694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:17.900458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:17.928157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:58:17.939377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:58:18.063082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3e42b81b-b837-4537-ba50-8d6953ff1ae7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.382396 May 11 05:58:18.081817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 16/34] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:58:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:58:18.092133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:18.113010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:18.137510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:18.155640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:18.157774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:18.158445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:18.224252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:18.238150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:18.256709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:18.264675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1c82c40d-ca0c-47e3-b5a8-bc276475f198 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1339 microversion: 2.20 time: 0.426673 May 11 05:58:18.281360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 19/35] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:17 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1339 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:18.281360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-44632778-e682-434f-98dd-d7268625d983 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:18.282677 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-44632778-e682-434f-98dd-d7268625d983 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:18.362465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:18.374477 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7e7be2fc-8283-4e78-b729-98f7695df589 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1236 microversion: 2.1 time: 0.286184 May 11 05:58:18.384951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 17/36] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:18 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1236 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:18.634749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-44632778-e682-434f-98dd-d7268625d983 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:18.669057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-44632778-e682-434f-98dd-d7268625d983 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1221 microversion: 2.1 time: 0.400569 May 11 05:58:18.696597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 20/37] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:18 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1221 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:18.853820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:18.855077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:18.866089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:18.868177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:18.880294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1597419575", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:18.888135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:18.889585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:19.029704 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] validate_networks() for [('b62a26f9-5853-46d1-925a-762af9a689ba', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:58:19.544687 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:19.559354 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ebf9a877-de54-4d09-8f1c-1c695ebaab3f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.709912 May 11 05:58:19.559961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 18/38] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:18 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:19.573800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:19.574711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:19.588303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:19.594381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:19.597220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:19.597764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:19.687308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:19.700389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:19.702859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:19.710336 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f2db7409-d1f8-4508-a6bf-ca6535c335f8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1339 microversion: 2.20 time: 0.148919 May 11 05:58:19.711892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:19 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1339 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:19.722339 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:19.729282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:19.745234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:19.745909 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:19.748990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:19.749643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:19.972013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:19.986367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-da0bccd1-d438-49df-b859-bdf3869942a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1298 microversion: 2.1 time: 0.272321 May 11 05:58:19.986964 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 20/40] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:19 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:20.579435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:20.580373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:20.590650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:20.596247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:20.597630 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:20.608051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:20.993898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:21.006755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-04587a9f-229f-462d-90dc-8ce3f896025a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.430644 May 11 05:58:21.039478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 21/41] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:20 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:21.060241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:21.061345 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:21.072889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.074001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.074521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.075379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.525063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:21.545849 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:21.548272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:21.550054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4efd38dc-1e6c-4b89-a6e6-46acb8e4dc41 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.509089 May 11 05:58:21.556018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:21 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:21.588758 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:21.589491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:21.605397 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.608061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.608883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.609328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.807319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:21.820634 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-55840a41-d363-4220-80a1-df741649f6aa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1298 microversion: 2.1 time: 0.261733 May 11 05:58:21.821255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 23/43] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:21 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1298 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:21.912074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:58:21.912643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:58:21.914374 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:58:21.915615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:58:21.916207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:58:21.936797 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.937880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.940372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:21.940995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:21.995685 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:22.002033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for user 28c76d12b0b1436d8eb0b23acf252f25 and project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:22.021416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:58:22.025020 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:58:22.042043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:22.042730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:22.054925 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.055732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:22.056709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.058137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:22.137638 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-326b43cf-9c16-4b09-b1f9-1755c5468410 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.261298 May 11 05:58:22.140492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 21/44] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:58:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 3266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:58:22.172934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3a020a66-701b-47a6-8729-ae4659d15c12 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:22.174372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3a020a66-701b-47a6-8729-ae4659d15c12 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:22.501985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:22.525463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b812e53d-a2b6-451b-aa4f-5d84e88e7b03 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.478107 May 11 05:58:22.536600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 24/45] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:22 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:22.585388 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:22.586283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:22.593939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3a020a66-701b-47a6-8729-ae4659d15c12 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:22.603822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3a020a66-701b-47a6-8729-ae4659d15c12 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1222 microversion: 2.1 time: 0.442140 May 11 05:58:22.613714 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 22/46] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:22 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1222 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:22.620753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.622100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:22.623382 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.624953 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:22.838182 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:22.838816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:22.847640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.850379 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:22.851220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:22.851679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:23.276447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:23.293971 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:23.299738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:23.300952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-86fb0b9c-2290-48c0-abd1-884ef9d4bdb1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.735086 May 11 05:58:23.301545 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 25/47] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:22 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:23.543700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:23.544577 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:23.559854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:23.561177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:23.566128 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:23.566705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:23.652907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:23.667279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-37541d3d-fe8c-499f-9bea-f4802993fee7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.833010 May 11 05:58:23.674197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 23/48] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:22 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:23.696176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:23.696808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:23.731501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:23.743734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:23.746295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:23.747555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:23.989465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:24.004632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:24.013218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4e875c32-e216-4e7b-a7e8-f5d4f5f3d86f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1274 microversion: 2.1 time: 0.337851 May 11 05:58:24.014870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9fae1464-25fc-4075-8d8e-60f1caf4501f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.474245 May 11 05:58:24.017000 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 24/49] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:23 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1274 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:24.018160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 26/50] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:23 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:24.321445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:24.322215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:24.326041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-4ca3a7cc-69d9-42a5-a16e-9198ef6b2c0c req-560d666e-aa08-415d-b081-6b682d7b27b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39347ca4-ad15-48cb-8486-41ea06de7fee", "name": "network-vif-plugged", "status": "completed", "tag": "a4a31f05-f49f-42aa-8746-ff5fe28d2566"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:24.334889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.335350 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.341831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.345797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.359352 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-4ca3a7cc-69d9-42a5-a16e-9198ef6b2c0c req-560d666e-aa08-415d-b081-6b682d7b27b5 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.363108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-4ca3a7cc-69d9-42a5-a16e-9198ef6b2c0c req-560d666e-aa08-415d-b081-6b682d7b27b5 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.472051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-4ca3a7cc-69d9-42a5-a16e-9198ef6b2c0c req-560d666e-aa08-415d-b081-6b682d7b27b5 service nova] Creating event network-vif-plugged:a4a31f05-f49f-42aa-8746-ff5fe28d2566 for instance 39347ca4-ad15-48cb-8486-41ea06de7fee on hv-cinder-73362 May 11 05:58:24.473031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-4ca3a7cc-69d9-42a5-a16e-9198ef6b2c0c req-560d666e-aa08-415d-b081-6b682d7b27b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 05:58:24.474512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.476331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.483872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.484922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.520929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.compute.rpcapi [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 05:58:24.526977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117334) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 05:58:24.599752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ede21806-2b2b-40f6-952f-4b30834ef8b8 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.576537 May 11 05:58:24.600643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 25/51] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:24.686616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:24.690604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:24.711150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.711855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:24.716532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:24.717194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.450971 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:25.464340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:25.466063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:25.467323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9c2b5555-8275-417f-95dd-79660c89513e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 1.151768 May 11 05:58:25.468062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:24 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:25.473355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:25.474273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:25.480906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:25.483158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.484064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:25.485307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.624646 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:25.632703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fa0bba37-3947-49aa-a002-38e7964eb553 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1280 microversion: 2.1 time: 0.162858 May 11 05:58:25.633840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 28/53] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:25 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:25.638946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:25.640066 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:25.647948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:25.648530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.649926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:25.650264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.699822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:25.712564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4debd553-c5d6-4428-813c-45f3a1cbbfd3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 1.031994 May 11 05:58:25.714542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 26/54] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:24 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:25.831812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-af174829-f817-49b3-9a76-85618245612e req-37d57f0e-c2e4-4ea5-b9e1-7db7bc42a672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2d041-06d4-4ffe-925b-2dead207e93f", "tag": "4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:25.849670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-af174829-f817-49b3-9a76-85618245612e req-37d57f0e-c2e4-4ea5-b9e1-7db7bc42a672 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:25.850147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-af174829-f817-49b3-9a76-85618245612e req-37d57f0e-c2e4-4ea5-b9e1-7db7bc42a672 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:25.877238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-af174829-f817-49b3-9a76-85618245612e req-37d57f0e-c2e4-4ea5-b9e1-7db7bc42a672 service nova] Creating event network-changed:4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c for instance 82b2d041-06d4-4ffe-925b-2dead207e93f on hv-cinder-73362 May 11 05:58:25.890153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-af174829-f817-49b3-9a76-85618245612e req-37d57f0e-c2e4-4ea5-b9e1-7db7bc42a672 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171102 May 11 05:58:25.891215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 27/55] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:25.972994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1184320914", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac42e169-a6e4-4ccc-996b-bc8a23c39701"}], "security_groups": [{"name": "tempest-securitygroup--2061357041"}], "key_name": "tempest-keypair-178086888", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:26.090048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:26.101423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-402e065a-3cc0-4d14-b734-e96db66ef07e tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.466211 May 11 05:58:26.111503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 29/56] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:25 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:26.119442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-75f214d6-0508-458a-a7e6-2b04674de43b req-f90d8af8-f652-4bfa-bf75-1b02b2f752a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:26.128990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-75f214d6-0508-458a-a7e6-2b04674de43b req-f90d8af8-f652-4bfa-bf75-1b02b2f752a4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:26.129731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-75f214d6-0508-458a-a7e6-2b04674de43b req-f90d8af8-f652-4bfa-bf75-1b02b2f752a4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:26.142462 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-75f214d6-0508-458a-a7e6-2b04674de43b req-f90d8af8-f652-4bfa-bf75-1b02b2f752a4 service nova] Creating event network-changed:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 05:58:26.149204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-75f214d6-0508-458a-a7e6-2b04674de43b req-f90d8af8-f652-4bfa-bf75-1b02b2f752a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036135 May 11 05:58:26.150119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 30/57] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:26.254315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] validate_networks() for [('ac42e169-a6e4-4ccc-996b-bc8a23c39701', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:58:26.488073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:26.488787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:26.501521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:26.504051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:26.504933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:26.507183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:26.754994 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:26.766686 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:26.768632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:26.770334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7e4126fb-8be8-4f10-ba24-14259294fcaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.287261 May 11 05:58:26.782386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 31/58] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:26 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:26.787445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:26.788146 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:26.794598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:26.795333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:26.796424 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:26.799700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:26.984883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:26.997797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f618678e-6359-4e0c-be2f-33f09dbb894c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.214120 May 11 05:58:26.998588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 32/59] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:26 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:27.022613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:27.023422 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:27.042465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.057503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.058431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.059475 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.100131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:58:27.100678 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:58:27.101031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:58:27.101669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:58:27.102262 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:58:27.118587 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.121876 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.123092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.127703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.166167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:58:27.187247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for user aa2d83bcc02a43f89ba4785a9bdedd15 and project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:58:27.201780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:58:27.206198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:58:27.272989 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c2f7b0f2-ef53-4743-bf67-34ec6427bfa3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.308751 May 11 05:58:27.275954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 28/60] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:58:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:58:27.292157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:27.293748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:27.303123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.303582 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.304588 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.305180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.353572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:27.371238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-31e9766d-f816-45ff-8d43-aac5de1f73c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.371223 May 11 05:58:27.372489 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 33/61] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:26 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:27.380962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-740ccb15-a785-44a2-bff3-8e5b129a3a61 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:27.382708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-740ccb15-a785-44a2-bff3-8e5b129a3a61 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:27.519380 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-740ccb15-a785-44a2-bff3-8e5b129a3a61 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:27.528060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-740ccb15-a785-44a2-bff3-8e5b129a3a61 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1237 microversion: 2.1 time: 0.153855 May 11 05:58:27.531885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 34/62] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:27 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:27.644468 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:27.655281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2ab885d9-1b55-4df5-b406-6b097f87aaa7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.377129 May 11 05:58:27.655899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 29/63] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:27 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:27.789071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:27.790398 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:27.808097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.808711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:27.809819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:27.810426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.018383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:28.019184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:28.036451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.042212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.043958 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.045079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.231960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:28.262439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:28.266546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:28.277532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ee873f23-ea05-4b4b-a103-b1082c919153 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.492458 May 11 05:58:28.282551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 35/64] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:27 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:28.389975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:28.392204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:28.404779 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.408257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.412040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.413742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.921044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:28.927694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:28.930452 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cde4842b-6c15-47a0-a8cf-959a972fdeec tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.544389 May 11 05:58:28.931720 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 36/65] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:28 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:28.935708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b3a37f79-6124-43ae-abab-488cb3e6d9b1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.923181 May 11 05:58:28.936279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 30/66] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:28 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:28.936612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-a0520343-d2be-44b0-a260-2cecae3be7b2 req-39f4de2d-be0b-4591-8a80-d584eb4d5aa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca", "tag": "e811e3dd-5519-4c8a-89e5-30c7a6732ff9"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:28.945954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a0520343-d2be-44b0-a260-2cecae3be7b2 req-39f4de2d-be0b-4591-8a80-d584eb4d5aa2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.946699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a0520343-d2be-44b0-a260-2cecae3be7b2 req-39f4de2d-be0b-4591-8a80-d584eb4d5aa2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.948789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:28.949489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:28.964496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-a0520343-d2be-44b0-a260-2cecae3be7b2 req-39f4de2d-be0b-4591-8a80-d584eb4d5aa2 service nova] Creating event network-changed:e811e3dd-5519-4c8a-89e5-30c7a6732ff9 for instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca on hv-cinder-73362 May 11 05:58:28.966931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.967547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.970135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.970780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.970954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-a0520343-d2be-44b0-a260-2cecae3be7b2 req-39f4de2d-be0b-4591-8a80-d584eb4d5aa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037884 May 11 05:58:28.971906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 37/67] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:28.978302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:28.981824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:28.990824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.991778 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:28.992652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:28.993340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.132536 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:29.145173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-cab756e1-d043-4de2-bb48-d418c9543264 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1289 microversion: 2.1 time: 0.203767 May 11 05:58:29.146443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 31/68] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:28 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1289 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:29.171491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:29.183569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-95b12c7a-604f-4794-905a-1e8de4058ec2 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1314 microversion: 2.1 time: 0.209785 May 11 05:58:29.194795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 38/69] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:28 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:29.300895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:29.301694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:29.322662 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.323366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.324652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.325247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.654847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:29.663783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:29.666626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:29.667755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-58fe8744-f390-40e2-aa91-8a8189c64521 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.372101 May 11 05:58:29.668816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 32/70] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:29 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:29.947575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:29.948179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:29.956089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:29.956709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:29.972003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.972454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.973234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.973698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.978123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.978577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:29.979349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:29.979781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.209732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:30.219281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1a213ebb-2913-4908-be06-1b5502494bd8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.275218 May 11 05:58:30.220208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 39/71] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:29 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:30.225970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:30.226653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:30.233118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.233730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.235332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.235816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.253679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:30.263435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-11e4e652-bac3-4707-ac03-50bd1f77ab37 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.311997 May 11 05:58:30.275134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 33/72] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:29 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:30.280835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:30.282235 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:30.289654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.290446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.291186 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.291841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.332840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:30.340741 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca494a24-d3c3-4f55-9e3d-dbddba2ed3a5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1297 microversion: 2.1 time: 0.119018 May 11 05:58:30.341598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 40/73] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:30 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:30.527781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:30.549127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-86ad47c2-80da-4650-b2cc-a733216e7522 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1500 microversion: 2.1 time: 0.272625 May 11 05:58:30.550641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 34/74] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:30 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:30.689716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:30.690532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:30.701537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.703740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.705356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:30.712715 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:30.999239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-f234dc13-64f4-43e9-93c7-d6fdc4cc3948 req-0618d36b-e892-4d36-8773-0119927aa689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673a67a9-f3f8-4070-b0e1-fb905b0f5dbc", "tag": "23a46e18-b3c4-4987-94de-348690945cd6"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:31.008962 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-f234dc13-64f4-43e9-93c7-d6fdc4cc3948 req-0618d36b-e892-4d36-8773-0119927aa689 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.019005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-f234dc13-64f4-43e9-93c7-d6fdc4cc3948 req-0618d36b-e892-4d36-8773-0119927aa689 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.067485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-f234dc13-64f4-43e9-93c7-d6fdc4cc3948 req-0618d36b-e892-4d36-8773-0119927aa689 service nova] Creating event network-changed:23a46e18-b3c4-4987-94de-348690945cd6 for instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc on hv-cinder-73362 May 11 05:58:31.100269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-f234dc13-64f4-43e9-93c7-d6fdc4cc3948 req-0618d36b-e892-4d36-8773-0119927aa689 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101802 May 11 05:58:31.114029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 35/75] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:58:31.238743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:31.240287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:31.257756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.258723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.264247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.266405 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.649359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.658469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.662004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-49cbf691-7205-4ccf-935b-c17d12cf405d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.427995 May 11 05:58:31.662651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 36/76] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:31 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:31.672514 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:31.674667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:31.675789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.677555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.678863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-07a95608-6e7f-4e98-9914-f0fb74e3d335 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.995710 May 11 05:58:31.690303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 41/77] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:30 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:31.691398 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.693507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.695670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.698006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.699313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:31.702594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:31.722798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.723504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.724471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:31.725075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:31.877685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.886957 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d9f5fda7-159d-4775-b94b-7531d5e955ea tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1295 microversion: 2.1 time: 0.194959 May 11 05:58:31.887533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 42/78] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:31 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1295 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:31.899353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:31.910559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a38024f2-99c3-4ff1-8851-717a6f2ac007 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.246738 May 11 05:58:31.911595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 37/79] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:31 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:32.312252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5324baec-b34f-4fc1-9cc6-50b9d3903dd2"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:32.313821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:32.321326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:32.322075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:32.323055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:32.323632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:32.680614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:32.682910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:32.693057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:32.693928 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:32.695108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:32.696764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:32.978010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:32.988980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1d8fc2df-2ad1-41e4-9551-757a8b59dca7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.311877 May 11 05:58:32.990792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 38/80] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:32 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:33.000559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:33.004193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:33.018941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.019402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.020228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.020673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.706194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2b983db7-1512-4533-99d9-1c2e54bebb6b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "POST /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.398771 May 11 05:58:33.706765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 43/81] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 05:58:32 2022] POST /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:33.720431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:33.721335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:33.743195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.743643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.758281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.759005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.893426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:33.904160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-414eee93-21f6-4aba-9f72-4a5fe327de45 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1295 microversion: 2.1 time: 0.196299 May 11 05:58:33.904746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 44/82] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:33 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1295 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:33.923687 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:33.924366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:33.936231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.936693 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.941797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:33.942309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:33.977544 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:33.992996 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:33.996266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:34.000293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-64e063a1-60f7-4147-94a0-480296fb9bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 1.008224 May 11 05:58:34.000996 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 39/83] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:32 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:34.013095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-02037fb0-f1ab-44f8-b1d2-3b62dcd02746 req-6090ec8a-9173-4cc1-9872-a0fca94c7345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2d041-06d4-4ffe-925b-2dead207e93f", "name": "network-vif-plugged", "status": "completed", "tag": "4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:34.039106 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-02037fb0-f1ab-44f8-b1d2-3b62dcd02746 req-6090ec8a-9173-4cc1-9872-a0fca94c7345 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:34.041295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-02037fb0-f1ab-44f8-b1d2-3b62dcd02746 req-6090ec8a-9173-4cc1-9872-a0fca94c7345 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:34.072896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-02037fb0-f1ab-44f8-b1d2-3b62dcd02746 req-6090ec8a-9173-4cc1-9872-a0fca94c7345 service nova] Creating event network-vif-plugged:4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c for instance 82b2d041-06d4-4ffe-925b-2dead207e93f on hv-cinder-73362 May 11 05:58:34.081240 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-02037fb0-f1ab-44f8-b1d2-3b62dcd02746 req-6090ec8a-9173-4cc1-9872-a0fca94c7345 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076870 May 11 05:58:34.085654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 40/84] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:34.101908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:34.102793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:34.119322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:34.122773 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:34.123865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:34.125634 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:34.598543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:34.606211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-56619d4f-7abc-42e8-88cb-460f3173de35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.518016 May 11 05:58:34.611056 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 41/85] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:34 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:34.664154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:34.675170 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-574e6298-3945-4fe9-8248-dda2350e5e54 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.766273 May 11 05:58:34.676212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 45/86] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:33 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:34.923966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:34.925043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:34.932669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:34.934342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:34.935986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:34.942652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.018377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:35.018987 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:35.027245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.029886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.034305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.034762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.306166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:35.317853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:35.320361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:35.321505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b89134dc-b076-4250-b47d-6cd825123953 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.308037 May 11 05:58:35.322582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 46/87] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:35 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:35.406702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:35.422338 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-04508b09-7bfd-47c7-904c-840e4deeb4df tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.504179 May 11 05:58:35.423528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 42/88] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:34 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:35.628341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:35.630728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:35.643264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.663795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.664769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.665320 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.696024 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:35.696650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:35.713011 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.713696 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:35.714673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:35.715266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:36.219142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:36.237619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-30ebd935-5445-49e4-981f-d4b653d48936 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1366 microversion: 2.1 time: 0.614075 May 11 05:58:36.240332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 47/89] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:35 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1366 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:36.248189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-c75d57f7-01be-41cf-a81f-eede30cf59f8 req-0d47ecc4-6a3f-4dc9-a930-219cfd2ab57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "name": "network-vif-plugged", "status": "completed", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:36.271417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c75d57f7-01be-41cf-a81f-eede30cf59f8 req-0d47ecc4-6a3f-4dc9-a930-219cfd2ab57f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:36.272358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c75d57f7-01be-41cf-a81f-eede30cf59f8 req-0d47ecc4-6a3f-4dc9-a930-219cfd2ab57f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:36.350121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-c75d57f7-01be-41cf-a81f-eede30cf59f8 req-0d47ecc4-6a3f-4dc9-a930-219cfd2ab57f service nova] Creating event network-vif-plugged:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 05:58:36.363575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-c75d57f7-01be-41cf-a81f-eede30cf59f8 req-0d47ecc4-6a3f-4dc9-a930-219cfd2ab57f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121043 May 11 05:58:36.364192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 48/90] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:36.369675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:36.379008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:36.401210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:36.402023 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:36.402675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:36.403116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:36.823349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:36.847185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:36.849712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:36.851643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7c5eb21d-cc13-4ebd-8d8a-bc8da340c050 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.485335 May 11 05:58:36.865052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 49/91] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:36 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:36.870610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:36.872084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:36.880182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:36.880937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:36.881958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:36.882629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.230257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:37.238584 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-788f6c3e-ecec-4143-9635-974bc2daa79c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 1.549154 May 11 05:58:37.241808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 43/92] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:35 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:37.242659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:37.256409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ebd2facf-26a8-42d7-a3d9-38b9202556ae tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.388489 May 11 05:58:37.257021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 50/93] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:36 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:37.271426 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:37.291545 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:37.300310 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.301183 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.302211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.302862 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.637085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:37.657882 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-15140c6e-85a0-4d3e-895d-8a2dbf7b6d5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1555 microversion: 2.1 time: 0.394017 May 11 05:58:37.658658 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 44/94] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:37 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1555 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:37.701505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:37.702185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:37.716913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.717445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.718295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.718874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.839478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-db136e70-aa14-4fcd-9edb-cfc44d1b1aa7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154752 May 11 05:58:37.840820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 51/95] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 05:58:37 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:37.871372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:37.871996 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:37.884725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.887272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.893558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.894064 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:37.972285 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-12d18c54-0774-4e83-81f0-cccf4843280c req-9a63a197-957c-43fd-85f2-54df716ecef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7c8f3d-2da4-4399-ac9d-42f991a37c96", "tag": "2222d0f9-acf4-4372-9885-2ac3de9a79e8"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:37.991923 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-12d18c54-0774-4e83-81f0-cccf4843280c req-9a63a197-957c-43fd-85f2-54df716ecef4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:37.992393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-12d18c54-0774-4e83-81f0-cccf4843280c req-9a63a197-957c-43fd-85f2-54df716ecef4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:38.028225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-12d18c54-0774-4e83-81f0-cccf4843280c req-9a63a197-957c-43fd-85f2-54df716ecef4 service nova] Creating event network-changed:2222d0f9-acf4-4372-9885-2ac3de9a79e8 for instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 on hv-cinder-73362 May 11 05:58:38.049425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-12d18c54-0774-4e83-81f0-cccf4843280c req-9a63a197-957c-43fd-85f2-54df716ecef4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081413 May 11 05:58:38.050389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 52/96] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:38.260062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:38.261410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:38.274247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:38.275192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:38.276207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:38.277131 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:38.322179 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:38.336228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:38.338721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:38.340213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-39d58d2a-99e4-4c8f-9bdc-380ec449cc0c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1406 microversion: 2.20 time: 0.473436 May 11 05:58:38.341575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 45/97] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:37 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:38.349925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:38.350985 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:38.368895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:38.369537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:38.370488 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:38.371593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:38.698283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:38.714854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-165d246b-698e-49f2-a454-1760527f0fba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.369806 May 11 05:58:38.715708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 46/98] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:38 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:38.961620 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:38.970947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-884d6f75-c9dd-4710-ac4c-513e5c3bf69e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.713629 May 11 05:58:38.974606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 53/99] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:38 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:39.359641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:39.360578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:39.373559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:39.374305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:39.375706 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:39.376348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:39.588692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-c0575f1f-54cc-4c7d-8f82-bc231fc92583 req-40423107-be18-448b-80cf-336902a1c336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca", "name": "network-vif-plugged", "status": "completed", "tag": "e811e3dd-5519-4c8a-89e5-30c7a6732ff9"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:39.600917 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c0575f1f-54cc-4c7d-8f82-bc231fc92583 req-40423107-be18-448b-80cf-336902a1c336 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:39.601719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c0575f1f-54cc-4c7d-8f82-bc231fc92583 req-40423107-be18-448b-80cf-336902a1c336 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:39.633199 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-c0575f1f-54cc-4c7d-8f82-bc231fc92583 req-40423107-be18-448b-80cf-336902a1c336 service nova] Creating event network-vif-plugged:e811e3dd-5519-4c8a-89e5-30c7a6732ff9 for instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca on hv-cinder-73362 May 11 05:58:39.645347 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-c0575f1f-54cc-4c7d-8f82-bc231fc92583 req-40423107-be18-448b-80cf-336902a1c336 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060462 May 11 05:58:39.649037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 54/100] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:58:39.734995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:39.735721 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:39.745864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:39.751029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:39.753869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:39.754662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:40.068635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:40.078342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-28bb447f-521d-4234-8d21-de3a91424ff0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.349185 May 11 05:58:40.080057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 55/101] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:39 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:40.086536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:40.087426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:40.094709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:40.095744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:40.096730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:40.097419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:40.208721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:40.219102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:40.221595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:40.224271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-923fd9e9-a34d-4d36-8c95-0a6f0efc2ad6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1599 microversion: 2.20 time: 0.868756 May 11 05:58:40.225353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 47/102] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:58:39 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1599 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:58:40.243891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:40.245954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:40.252882 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:40.253671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:40.255014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:40.255665 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:40.334567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:40.345349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b0176632-7492-4dd0-8122-aaa82e23ad4c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.263851 May 11 05:58:40.346560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 56/103] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:40 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:40.513627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9c4a3a86-a51a-4a0e-af04-05be396108d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.274021 May 11 05:58:40.514575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 48/104] 10.222.0.44 () {60 vars in 1315 bytes} [Wed May 11 05:58:40 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 05:58:41.097791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:41.098511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:41.110262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.113884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.115219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.116483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.363933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:41.364752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:41.378861 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.384893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.393646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.396383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.657323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:41.667803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2a39a235-9301-439c-9ac2-7efe7dce9fe9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.309157 May 11 05:58:41.672674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 49/105] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:41 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:41.698895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-74397d5f-afe6-49a6-8098-46347668bb87 req-e303e42d-8673-4ea4-87be-6c7acc9a8c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82b2d041-06d4-4ffe-925b-2dead207e93f", "tag": "4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:41.708300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:41.721510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8f0f1681-6af5-4b90-b0a3-27ec0bc5a573 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.625015 May 11 05:58:41.723584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 57/106] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:41 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:41.743306 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-ec741545-db3f-4f70-bec0-666a513591fc req-c2e3a7dd-1540-4d9d-963f-79b47fc64e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673a67a9-f3f8-4070-b0e1-fb905b0f5dbc", "name": "network-vif-plugged", "status": "completed", "tag": "23a46e18-b3c4-4987-94de-348690945cd6"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:41.744085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-74397d5f-afe6-49a6-8098-46347668bb87 req-e303e42d-8673-4ea4-87be-6c7acc9a8c0d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.745243 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-74397d5f-afe6-49a6-8098-46347668bb87 req-e303e42d-8673-4ea4-87be-6c7acc9a8c0d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.773148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ec741545-db3f-4f70-bec0-666a513591fc req-c2e3a7dd-1540-4d9d-963f-79b47fc64e63 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:41.805387 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ec741545-db3f-4f70-bec0-666a513591fc req-c2e3a7dd-1540-4d9d-963f-79b47fc64e63 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:41.839135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-74397d5f-afe6-49a6-8098-46347668bb87 req-e303e42d-8673-4ea4-87be-6c7acc9a8c0d service nova] Creating event network-changed:4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c for instance 82b2d041-06d4-4ffe-925b-2dead207e93f on hv-cinder-73362 May 11 05:58:41.855195 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-74397d5f-afe6-49a6-8098-46347668bb87 req-e303e42d-8673-4ea4-87be-6c7acc9a8c0d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180780 May 11 05:58:41.868080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-ec741545-db3f-4f70-bec0-666a513591fc req-c2e3a7dd-1540-4d9d-963f-79b47fc64e63 service nova] Creating event network-vif-plugged:23a46e18-b3c4-4987-94de-348690945cd6 for instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc on hv-cinder-73362 May 11 05:58:41.868628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 50/107] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:41.878014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-ec741545-db3f-4f70-bec0-666a513591fc req-c2e3a7dd-1540-4d9d-963f-79b47fc64e63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146782 May 11 05:58:41.880030 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 58/108] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:42.692796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:42.695354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:42.705248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:42.706236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:42.707396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:42.708736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:42.740801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:42.741531 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:42.767296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:42.767778 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:42.768573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:42.769005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:43.326063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:43.334443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-be5c7b33-dd7e-4ac8-8369-f8c050afe31e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.650773 May 11 05:58:43.336450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 51/109] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:42 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:43.462064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:43.474267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cd8c2e21-b4bf-4580-8be0-502ea3a6591c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.738008 May 11 05:58:43.474867 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 59/110] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:42 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:43.910957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-197f69c9-cd0e-43f6-9e23-f85979396b1e req-80f88c27-a3d2-4e09-8d73-9329c398dd29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:43.962091 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:43.963552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-197f69c9-cd0e-43f6-9e23-f85979396b1e req-80f88c27-a3d2-4e09-8d73-9329c398dd29 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:43.964186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:43.966376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-197f69c9-cd0e-43f6-9e23-f85979396b1e req-80f88c27-a3d2-4e09-8d73-9329c398dd29 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:43.985889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:43.987560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:43.988366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:43.988802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.020187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-197f69c9-cd0e-43f6-9e23-f85979396b1e req-80f88c27-a3d2-4e09-8d73-9329c398dd29 service nova] Creating event network-changed:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 05:58:44.050230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-197f69c9-cd0e-43f6-9e23-f85979396b1e req-80f88c27-a3d2-4e09-8d73-9329c398dd29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145968 May 11 05:58:44.052388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 52/111] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:44.094723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 05:58:44.318378 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b152885f-c237-4a52-b9e4-6d9cbaec2efb tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 204 len: 0 microversion: 2.1 time: 0.369713 May 11 05:58:44.319725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 60/112] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 05:58:43 2022] DELETE /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 05:58:44.328665 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:44.329701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:44.344040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.344501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.346812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.347271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.354602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:44.356624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:44.384890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.389681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.399053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.404497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.745767 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:44.759255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-43e466bb-7ad4-43d9-be66-968c9294f2f5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.409546 May 11 05:58:44.760925 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 61/113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:44 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:44.771789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:44.772693 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:44.784281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.784906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.786558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:44.787094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:44.796630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:44.807558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-770b87af-9e65-4c71-bc4d-6becb04cea56 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.481964 May 11 05:58:44.808177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 53/114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:44 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:45.083662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:45.108196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1f1838a1-9ade-49dd-b7f8-ff4104ba5d94 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.344789 May 11 05:58:45.108863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 62/115] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:44 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:45.778442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:45.779694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:45.792429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:45.795052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:45.796664 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:45.798052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:45.838504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:45.839181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:45.854372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:45.856419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:45.859301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:45.862728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:46.105956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:46.116590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4cb0d368-3d35-4784-845d-29ea823299b7 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.293996 May 11 05:58:46.130981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 63/116] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:45 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:46.136592 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:46.137757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:46.158606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:46.160740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:46.163054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:46.163650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:46.227886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:46.238818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8bfbf8e3-e342-4723-bb1c-784227f17965 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.463477 May 11 05:58:46.242223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 54/117] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:45 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:46.393002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:46.402873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca4d86ba-b917-4d6d-9e24-402ebc8d474b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.270555 May 11 05:58:46.403679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 64/118] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:46 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:47.142218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:47.143124 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:47.153978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.164329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.165364 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.165837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.259532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:47.260155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:47.268179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.268668 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.269445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.279400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.601960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:47.609876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fb9b35b3-61c7-4c6f-a0fd-ce5d9fe71062 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.356953 May 11 05:58:47.610946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 65/119] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:47 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:47.617841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:47.618795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:47.625996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.626894 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.627682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:47.628208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:47.707388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:47.717689 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7ba213ed-a305-4544-878f-982768a1d685 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.584796 May 11 05:58:47.728976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 55/120] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:47 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:48.005121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:48.017155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3c479d22-b506-4399-b0ed-725ae630a304 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.404629 May 11 05:58:48.017957 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 66/121] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:47 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:48.628444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:48.629213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:48.636435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:48.637642 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:48.638519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:48.639126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:48.740904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:48.742701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:48.753034 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:48.753034 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:48.753924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:48.754363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:48.948761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:48.959430 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2088c58d-e934-4c5a-a8eb-8a673fad7b49 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.226966 May 11 05:58:48.962447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:48.963484 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 67/122] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:48 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:48.972266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5979f044-b300-407c-99da-bf469db0bf41 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.348146 May 11 05:58:48.975044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 56/123] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:48 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:49.033753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:49.034611 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:49.040932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:49.041618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:49.042384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:49.042960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:49.237121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:49.246560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d646153b-9b7c-4b46-a265-ae234ead0598 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.217148 May 11 05:58:49.248711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 68/124] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:49 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:49.977116 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:49.977880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:49.989854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:49.990618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:49.996108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:49.999104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:50.000267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.001162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:50.001953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.002412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.007255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:50.009205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.196662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:50.204554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-598e9b9f-9fa2-4e1b-b442-b8d1013bf555 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.218487 May 11 05:58:50.205691 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 69/125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:49 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:50.236772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:50.244873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3a3a56c7-4be8-46dc-8cf7-ca42858897c1 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.271970 May 11 05:58:50.245775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 57/126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:49 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:50.264010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:50.264703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:50.271574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:50.272220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.272990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:50.273417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:50.443448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:50.451426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-59081307-1c8b-4d2c-9a04-481c03b89786 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.191180 May 11 05:58:50.452946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 70/127] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:50 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:51.222049 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:51.222668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:51.231340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.232132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:51.233043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.234288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:51.263888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:51.264493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:51.288963 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.294015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:51.295569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.296777 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:51.691397 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:51.700436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:51.705819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-83bf1799-3da6-44a8-b4af-16c8221937b9 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1552 microversion: 2.1 time: 0.447043 May 11 05:58:51.716075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 71/128] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:51 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1552 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:51.720120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-05dcb43e-4ec3-40be-ab1f-421e9a754f00 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1322 microversion: 2.1 time: 0.501957 May 11 05:58:51.722165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 58/129] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:51 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:51.726531 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:51.727161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:51.734792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.735302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:51.736098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:51.737163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.041512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-12033d78-39e2-45d9-b134-c4ae6ad3891c req-65dfea5a-a52e-45fb-a268-78928af8418a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c8f3d-2da4-4399-ac9d-42f991a37c96", "name": "network-vif-plugged", "status": "completed", "tag": "2222d0f9-acf4-4372-9885-2ac3de9a79e8"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:52.053485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-12033d78-39e2-45d9-b134-c4ae6ad3891c req-65dfea5a-a52e-45fb-a268-78928af8418a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:52.055410 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-12033d78-39e2-45d9-b134-c4ae6ad3891c req-65dfea5a-a52e-45fb-a268-78928af8418a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.083622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-12033d78-39e2-45d9-b134-c4ae6ad3891c req-65dfea5a-a52e-45fb-a268-78928af8418a service nova] Creating event network-vif-plugged:2222d0f9-acf4-4372-9885-2ac3de9a79e8 for instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 on hv-cinder-73362 May 11 05:58:52.089438 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-12033d78-39e2-45d9-b134-c4ae6ad3891c req-65dfea5a-a52e-45fb-a268-78928af8418a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051707 May 11 05:58:52.091038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 59/130] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:52.398887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:52.415044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-de7a07b5-1e0b-43db-9379-139b15223a72 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.694208 May 11 05:58:52.429127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 72/131] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:51 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:52.729419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:52.731376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:52.740578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:52.741783 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:52.743546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:52.745826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.748543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:52.750194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.756385 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:52.757959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.758789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:52.764161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:52.915615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:52.934358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8ad3a13d-965c-4d48-82b3-c60f3592b80c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1510 microversion: 2.1 time: 0.206196 May 11 05:58:52.944964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 60/132] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:52 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:52.978176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-b573731a-0715-4d77-9d19-719ab9d51eca req-58408a64-0678-47fd-a88f-76d692516e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39347ca4-ad15-48cb-8486-41ea06de7fee", "name": "network-vif-deleted", "tag": "a4a31f05-f49f-42aa-8746-ff5fe28d2566"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:53.003551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-b573731a-0715-4d77-9d19-719ab9d51eca req-58408a64-0678-47fd-a88f-76d692516e29 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.009883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-b573731a-0715-4d77-9d19-719ab9d51eca req-58408a64-0678-47fd-a88f-76d692516e29 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.041668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-b573731a-0715-4d77-9d19-719ab9d51eca req-58408a64-0678-47fd-a88f-76d692516e29 service nova] Creating event network-vif-deleted:a4a31f05-f49f-42aa-8746-ff5fe28d2566 for instance 39347ca4-ad15-48cb-8486-41ea06de7fee on hv-cinder-73362 May 11 05:58:53.057640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-b573731a-0715-4d77-9d19-719ab9d51eca req-58408a64-0678-47fd-a88f-76d692516e29 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097027 May 11 05:58:53.059243 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 61/133] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:53.081508 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:53.089393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-420e3a94-d93a-46dc-b251-da1e1fa43433 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1515 microversion: 2.1 time: 0.357101 May 11 05:58:53.109875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 73/134] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:52 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:53.122899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:53.123979 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:53.136159 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.136832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.138025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.138806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.169205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'flavor' on Instance uuid 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 05:58:53.433595 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:53.434211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:53.447487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.449091 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.452708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.453444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.492743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c5acbab3-801b-4b0c-954f-b3847430b1db tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc/action" status: 200 len: 32 microversion: 2.1 time: 0.377699 May 11 05:58:53.506056 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 62/135] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 05:58:53 2022] POST /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 05:58:53.517556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:53.524003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:53.532591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.533088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.534128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.534755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.728841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:53.745874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fb2ff9d4-ace0-4cc6-9f7b-e91d9c49c66c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.238419 May 11 05:58:53.746472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 63/136] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:53 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:53.758054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:53.775790 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f6e13af0-4099-43e9-a441-8661c64ef1fe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1363 microversion: 2.1 time: 0.347011 May 11 05:58:53.776407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 74/137] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:53 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1363 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:53.965548 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:53.970072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:53.984110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.984726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:53.985846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:53.987195 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:54.071386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:54.084772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e8c44242-f2f1-4ac1-b4a9-daf4b6bf22fa tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1345 microversion: 2.1 time: 0.136272 May 11 05:58:54.086617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 64/138] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:53 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:54.111509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-a8d936ce-80fc-4a78-bd90-5b76bba9100a req-d339e7cc-65ed-4c00-9fb5-0bc7ab3abd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39347ca4-ad15-48cb-8486-41ea06de7fee", "name": "network-vif-unplugged", "status": "completed", "tag": "a4a31f05-f49f-42aa-8746-ff5fe28d2566"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:54.122450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a8d936ce-80fc-4a78-bd90-5b76bba9100a req-d339e7cc-65ed-4c00-9fb5-0bc7ab3abd73 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:54.123250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a8d936ce-80fc-4a78-bd90-5b76bba9100a req-d339e7cc-65ed-4c00-9fb5-0bc7ab3abd73 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:54.142689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-a8d936ce-80fc-4a78-bd90-5b76bba9100a req-d339e7cc-65ed-4c00-9fb5-0bc7ab3abd73 service nova] Creating event network-vif-unplugged:a4a31f05-f49f-42aa-8746-ff5fe28d2566 for instance 39347ca4-ad15-48cb-8486-41ea06de7fee on hv-cinder-73362 May 11 05:58:54.147876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-a8d936ce-80fc-4a78-bd90-5b76bba9100a req-d339e7cc-65ed-4c00-9fb5-0bc7ab3abd73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040704 May 11 05:58:54.149031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 75/139] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:54.763381 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:54.764079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:54.778073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:54.782334 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:54.783554 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:54.788584 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:54.795576 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:54.796995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:54.806324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:54.806618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:54.818022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:54.818693 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.111329 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:55.120189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2291be72-e04a-46ca-be34-80c12422cf24 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1549 microversion: 2.1 time: 0.329517 May 11 05:58:55.124633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 76/140] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:54 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1549 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:58:55.138843 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:55.139501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:55.153521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:55.154212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.155972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:55.156731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.158718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:55.166864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2558cdb8-8d6a-492f-b862-ac87775f4a90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.407480 May 11 05:58:55.167454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 65/141] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:54 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:55.193013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:55.194598 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:55.210077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:55.210516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.211311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:55.211759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.241374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:55.247503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:55.248599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lazy-loading 'fault' on Instance uuid 39347ca4-ad15-48cb-8486-41ea06de7fee {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 05:58:55.405004 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdceba628fb45b0a7d42547cd1c0f4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98d1a529cc4d4a11b49d9e08ae5b2f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:55.435755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-779b943d-54ae-4f8e-91e0-254d9cfdc70a tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 200 len: 1350 microversion: 2.1 time: 0.308066 May 11 05:58:55.438119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 77/142] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:55 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 1350 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:56.011091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9b7cfe09-02eb-4426-9b8f-2c0c87ce5053 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.829904 May 11 05:58:56.012308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 66/143] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 05:58:55 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-interface => generated 284 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:56.184110 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:56.184707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:56.196121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.196495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.197272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.198952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.460265 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:56.460890 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:56.469762 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.470459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.471452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.473188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.521863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] HTTP exception thrown: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Request method failure captured: May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee HTTP/1.1 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BbUgbY2w_VeZ5zaFS3mYynOFbK_qFTlLkhbScKtod1U5b4pR6ytNkyuUkZlDUjh1Pj8KF5IMlRTtbywh4GCoT3016UYidB8q3JPlyv8ol1wAOgtHOn6uVVcPDUXWq9VpAX12qJwH6DgppTF9kB_ps1Gi7xl6eyai7iCoZhJF8bFl8 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 05:58:56.538508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}] May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 9fdceba628fb45b0a7d42547cd1c0f4f May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.539885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '39347ca4-ad15-48cb-8486-41ea06de7fee'} May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:58:56.540599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.541788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.551542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Returning 404 to user: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:58:56.552567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9fd054dd-f8e3-466e-a95a-9b5a5dfd096f tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 404 len: 111 microversion: 2.1 time: 0.101999 May 11 05:58:56.555810 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 67/144] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:56 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 05:58:56.786973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:56.787980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:56.828107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.829436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.840935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:56.842257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:56.900608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] HTTP exception thrown: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Request method failure captured: May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee/os-volume_attachments HTTP/1.1 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BbUgbY2w_VeZ5zaFS3mYynOFbK_qFTlLkhbScKtod1U5b4pR6ytNkyuUkZlDUjh1Pj8KF5IMlRTtbywh4GCoT3016UYidB8q3JPlyv8ol1wAOgtHOn6uVVcPDUXWq9VpAX12qJwH6DgppTF9kB_ps1Gi7xl6eyai7iCoZhJF8bFl8 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 05:58:56.914095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}] May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 9fdceba628fb45b0a7d42547cd1c0f4f May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.915423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'server_id': '39347ca4-ad15-48cb-8486-41ea06de7fee'} May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:58:56.916073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:56.917115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 05:58:56.922504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Returning 404 to user: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:58:56.923734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1212efc0-21bc-4d69-bc53-d6e86c4e204b tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.143333 May 11 05:58:56.927177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 68/145] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 05:58:56 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee/os-volume_attachments => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 05:58:57.263557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:57.273887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e6687f5a-ba63-40df-a6f6-fbe1b73d337d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 1.093440 May 11 05:58:57.274470 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 78/146] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:56 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:58.293962 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:58.294799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:58.312978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-e2f8778c-7a29-4ac6-a176-1249d360002a req-062cc27a-4208-49d4-9561-f75437470974 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7c8f3d-2da4-4399-ac9d-42f991a37c96", "tag": "2222d0f9-acf4-4372-9885-2ac3de9a79e8"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:58:58.321404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-e2f8778c-7a29-4ac6-a176-1249d360002a req-062cc27a-4208-49d4-9561-f75437470974 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.326751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.335407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.337201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.337688 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.346049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-e2f8778c-7a29-4ac6-a176-1249d360002a req-062cc27a-4208-49d4-9561-f75437470974 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.371637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-e2f8778c-7a29-4ac6-a176-1249d360002a req-062cc27a-4208-49d4-9561-f75437470974 service nova] Creating event network-changed:2222d0f9-acf4-4372-9885-2ac3de9a79e8 for instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 on hv-cinder-73362 May 11 05:58:58.377269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-e2f8778c-7a29-4ac6-a176-1249d360002a req-062cc27a-4208-49d4-9561-f75437470974 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068628 May 11 05:58:58.378629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 79/147] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:58:58.530976 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:58.531937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:58.546253 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.548690 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.551135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.551681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.604722 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] HTTP exception thrown: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Request method failure captured: May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee HTTP/1.1 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BbUgbY2w_VeZ5zaFS3mYynOFbK_qFTlLkhbScKtod1U5b4pR6ytNkyuUkZlDUjh1Pj8KF5IMlRTtbywh4GCoT3016UYidB8q3JPlyv8ol1wAOgtHOn6uVVcPDUXWq9VpAX12qJwH6DgppTF9kB_ps1Gi7xl6eyai7iCoZhJF8bFl8 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 05:58:58.616298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}] May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 9fdceba628fb45b0a7d42547cd1c0f4f May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.617791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '39347ca4-ad15-48cb-8486-41ea06de7fee'} May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:58:58.618560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.619859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.625691 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Returning 404 to user: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:58:58.632542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5a340b19-3aa2-4418-a20c-89fc1e477a3c tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "DELETE /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 404 len: 111 microversion: 2.1 time: 0.106741 May 11 05:58:58.636658 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 80/148] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 05:58:58 2022] DELETE /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 05:58:58.643183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:58.644002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] [instance: 39347ca4-ad15-48cb-8486-41ea06de7fee] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:58.658454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.659880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.661643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:58.666520 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:58.715507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] HTTP exception thrown: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Request method failure captured: May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee HTTP/1.1 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BbUgbY2w_VeZ5zaFS3mYynOFbK_qFTlLkhbScKtod1U5b4pR6ytNkyuUkZlDUjh1Pj8KF5IMlRTtbywh4GCoT3016UYidB8q3JPlyv8ol1wAOgtHOn6uVVcPDUXWq9VpAX12qJwH6DgppTF9kB_ps1Gi7xl6eyai7iCoZhJF8bFl8 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 05:58:58.724904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/98d1a529cc4d4a11b49d9e08ae5b2f69"}]}] May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 98d1a529cc4d4a11b49d9e08ae5b2f69 May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-DeleteServersTestJSON-225854951 May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 9fdceba628fb45b0a7d42547cd1c0f4f May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-DeleteServersTestJSON-225854951-project May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.726355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '39347ca4-ad15-48cb-8486-41ea06de7fee'} May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 05:58:58.727218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. May 11 05:58:58.728564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 05:58:58.730627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] Returning 404 to user: Instance 39347ca4-ad15-48cb-8486-41ea06de7fee could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 05:58:58.731718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a57e31b3-8a38-4ee2-b52d-2b7cd4d3b461 tempest-DeleteServersTestJSON-225854951 tempest-DeleteServersTestJSON-225854951-project] 10.222.0.44 "GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee" status: 404 len: 111 microversion: 2.1 time: 0.093845 May 11 05:58:58.737109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 81/149] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:58 2022] GET /compute/v2.1/servers/39347ca4-ad15-48cb-8486-41ea06de7fee => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 05:58:58.755382 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:58:58.763618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-aa01f6db-e4b0-4966-8ff3-78ab78d5050a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.475592 May 11 05:58:58.767427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 69/150] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:58 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:58:59.786632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:58:59.787295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:58:59.795143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:59.804518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:58:59.805547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:58:59.806050 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:00.209854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:00.218840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-08f83994-bd3f-42b5-a3c4-0c44bdf9d2c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.439301 May 11 05:59:00.220152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 82/151] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:58:59 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:01.238557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:01.240528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:01.253203 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:01.254663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:01.255806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:01.256256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:01.550241 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:01.570512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-89b2818b-2de3-4901-b16a-aafee9cabc02 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.335771 May 11 05:59:01.591964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 70/152] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:01 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:02.588266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:02.589963 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:02.597290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:02.597999 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:02.598966 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:02.602596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:02.759190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:02.768715 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-be63719d-23ef-4420-8766-f8cedb14779b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.184247 May 11 05:59:02.776109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 83/153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:02 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:03.789003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:03.789711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:03.797733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:03.798183 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:03.798990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:03.799599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:03.960351 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:03.974275 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9d7446b1-8067-41c5-a90d-16b10048965d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.192318 May 11 05:59:03.975032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 71/154] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:03 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:04.991623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:04.992363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:05.000197 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:05.000197 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:05.002080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:05.004001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:05.162152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:05.177464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9ddcd6f0-49de-48d2-8608-27a97f1e7917 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.189888 May 11 05:59:05.180662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 84/155] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:04 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:06.136215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c8206027-6f85-4b52-a392-dbf7bd66a64b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'create', calling method: .version_select at 0x7fa1402145e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1693681529", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2gUPZ5ROexuvn/GkDsX4CDvnep8RzvSfvaCOB+UKtISFV+sRzMpc/Fl3799mOTiATuUgPxIrZnSUsgwj5T0BqoFth8C/1C8XfipQiZVFR+ePAVPxRdyU3y68DbAJy7hA=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:06.155875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c8206027-6f85-4b52-a392-dbf7bd66a64b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Getting quotas for project 4285af910bec40c4a5a5691d5492f941. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:06.159926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c8206027-6f85-4b52-a392-dbf7bd66a64b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Getting quotas for user 9f19dad38bba4adb9267a1fcbc26d7b2 and project 4285af910bec40c4a5a5691d5492f941. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:06.199008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:06.200271 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:06.202530 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c8206027-6f85-4b52-a392-dbf7bd66a64b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.069794 May 11 05:59:06.207174 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:06.207704 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:06.208573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:06.209077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:06.210712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 72/156] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 05:59:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:59:06.317018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1303609562", "imageRef": "e1db4c70-1d11-4da6-8be5-06c28c30918d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1693681529", "networks": [{"uuid": "626aa50b-f8ab-4c0a-a0db-c276fe88c2c3"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:06.358983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:06.370476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bd721136-b305-43c4-aba5-188833a8ea36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.175515 May 11 05:59:06.371880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 85/157] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:06 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:06.385185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] validate_networks() for [('626aa50b-f8ab-4c0a-a0db-c276fe88c2c3', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:59:06.867417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:59:06.868086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:59:06.868790 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:59:06.869919 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:59:06.870562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:59:06.880834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:06.881399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:06.882376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:06.882905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:06.903669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Getting quotas for project 4285af910bec40c4a5a5691d5492f941. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:06.913350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Getting quotas for user 9f19dad38bba4adb9267a1fcbc26d7b2 and project 4285af910bec40c4a5a5691d5492f941. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:06.926706 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:59:06.928983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e1db4c70-1d11-4da6-8be5-06c28c30918d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:59:06.994369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-262c701c-8927-485f-9ed7-ceaa8e039c55 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681198 May 11 05:59:06.995296 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 73/158] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:59:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:59:07.005415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-52e06a5d-c2f5-4988-9aa3-12801a0ea0c2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:07.006203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-52e06a5d-c2f5-4988-9aa3-12801a0ea0c2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:07.072418 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-52e06a5d-c2f5-4988-9aa3-12801a0ea0c2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:07.080689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-52e06a5d-c2f5-4988-9aa3-12801a0ea0c2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1259 microversion: 2.1 time: 0.079420 May 11 05:59:07.081256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 86/159] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:06 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1259 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:07.388370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:07.388987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:07.397292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:07.397907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:07.398857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:07.399293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:07.556861 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:07.564589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7459a50a-cc4c-466c-a986-dd0cb6041bc5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.180368 May 11 05:59:07.565173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 74/160] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:07 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:08.098372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:08.099094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:08.105269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:08.105750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:08.106523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:08.106962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:08.180002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:08.190663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c067b6a6-4038-4d41-82cb-c14932592bff tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1311 microversion: 2.1 time: 0.096056 May 11 05:59:08.191319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 87/161] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:08 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:08.591342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:08.592814 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:08.609080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:08.610406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:08.612045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:08.615067 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:08.923294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:08.935380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0621dd70-c112-493c-a514-3be10939eea4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.356329 May 11 05:59:08.946414 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 75/162] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:08 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:09.210511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:09.211033 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:09.221046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:09.221542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:09.222299 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:09.222734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:09.533528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:09.543623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e81ae9a6-7f78-4c1e-9b10-c925ca6fedf0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.337210 May 11 05:59:09.562021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 88/163] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:09 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:09.957851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:09.960210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:09.968119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:09.970126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:09.971396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:09.972150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:10.440825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:10.452083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2c04c4a0-40bc-43bc-96c6-ce649a9cc9d1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.498525 May 11 05:59:10.462743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 76/164] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:09 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:10.562832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:10.563633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:10.582839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:10.585191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:10.586270 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:10.587676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:10.749871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-799325c2-3e4c-4af6-9932-ed803be59bfb req-9a4faf25-146b-4419-8dda-9f2bae4a39c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:10.766804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-799325c2-3e4c-4af6-9932-ed803be59bfb req-9a4faf25-146b-4419-8dda-9f2bae4a39c3 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:10.767848 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-799325c2-3e4c-4af6-9932-ed803be59bfb req-9a4faf25-146b-4419-8dda-9f2bae4a39c3 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:10.796210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-799325c2-3e4c-4af6-9932-ed803be59bfb req-9a4faf25-146b-4419-8dda-9f2bae4a39c3 service nova] Creating event network-changed:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 05:59:10.804619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-799325c2-3e4c-4af6-9932-ed803be59bfb req-9a4faf25-146b-4419-8dda-9f2bae4a39c3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060517 May 11 05:59:10.816521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 77/165] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:59:10.868816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:10.879676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0137c4b7-9211-48ff-a151-d12a2a9e07f6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.320793 May 11 05:59:10.880266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 89/166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:10 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:11.471036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:11.472654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:11.488611 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:11.489190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:11.490114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:11.490552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:11.759184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:11.771004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-aed0925d-39fa-4db3-b087-bcb50341719c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.305891 May 11 05:59:11.773019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 78/167] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:11 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:11.898970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:11.900317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:11.908309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:11.909400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:11.910360 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:11.910915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:12.080720 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:12.089887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c1524f7a-c0ac-4699-a287-61af8cab0665 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.197026 May 11 05:59:12.091262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 90/168] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:11 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:12.798645 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:12.800402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:12.814937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:12.817063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:12.818961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:12.819922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:13.117676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:13.127404 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:13.129020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:13.139136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:13.139961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:13.141276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:13.142275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:13.156062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-339654ef-4b8b-4df4-8728-159255f69461 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.368759 May 11 05:59:13.156986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 79/169] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:12 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:13.402533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:13.410821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1e7a4a71-bbb3-4456-8fd2-4d3ea2a7cefb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.307262 May 11 05:59:13.411490 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 91/170] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:13 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:14.178735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:14.178735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:14.190711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:14.191180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:14.194213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:14.196090 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:14.429043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:14.432370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:14.445423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:14.446296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:14.447358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:14.448401 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:14.537196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:14.544804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ba15626f-7df0-4cd1-9786-24bfb4e30fa7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.375767 May 11 05:59:14.554491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 80/171] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:14 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:14.645245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:14.653001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2284bce6-8c20-4c74-a968-fa5aee1b3738 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.228504 May 11 05:59:14.653599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 92/172] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:14 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:15.571829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:15.572476 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:15.588153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:15.588948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:15.600494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:15.601318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:15.673105 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:15.674088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:15.690296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:15.690757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:15.696474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:15.697083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:15.986897 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:15.994361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b3a26cb7-cb83-4f46-a1b2-ce7fba3ef0fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.426444 May 11 05:59:15.994959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 81/173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:15 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:16.059770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:16.084901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-af337bce-40c6-4873-a515-6ef40f8ad5a7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.417711 May 11 05:59:16.085806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 93/174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:15 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:17.012392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:17.013933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:17.034319 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:17.035047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:17.036358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:17.036943 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:17.106374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:17.108306 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:17.123803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:17.126546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:17.147363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:17.149730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:17.387798 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:17.413531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7928b497-9e0b-410e-a4dd-6d7e6779f7d3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.406155 May 11 05:59:17.414190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 82/175] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:17 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:17.505781 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:17.527105 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-997aefa1-1dcf-44d1-81a5-8f735b6ce4d6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.421626 May 11 05:59:17.528035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 94/176] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:17 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:18.436359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:18.437750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:18.458489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:18.459306 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:18.461085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:18.462264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:18.546589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:18.548014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:18.556721 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:18.559566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:18.561184 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:18.561994 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:18.844511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:18.853926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3b6f6dc4-5d9e-4b35-84b3-3045b0c46a9e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.422214 May 11 05:59:18.856133 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 83/177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:18 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:19.190935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:19.204366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-80036cb0-d6a8-4886-b37f-8e18a2ecd539 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.662856 May 11 05:59:19.210277 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 95/178] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:18 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:19.872647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:19.874871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:19.882159 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:19.883531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:19.884353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:19.884787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:20.147922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:20.157509 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b9c819fb-5aac-4422-87d5-7ded4f15ac36 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.288592 May 11 05:59:20.173413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 84/179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:19 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:20.227366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:20.227988 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:20.239523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:20.240188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:20.241008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:20.241491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:20.385601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:20.394461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-abb3577f-6693-4d5e-ab42-20e9061981b5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.171369 May 11 05:59:20.395058 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 96/180] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:20 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:21.179825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:21.181213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:21.194839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:21.195904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:21.199391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:21.199966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:21.375974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:21.383432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b9751fa0-898e-4f9b-80ea-15bd36c203b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.211026 May 11 05:59:21.384134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 85/181] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:21 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:21.411503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:21.412144 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:21.418548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:21.418894 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:21.419672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:21.420723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:21.712297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:21.731627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-997638b5-b188-48e0-9f04-fa536895fe35 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.321455 May 11 05:59:21.733665 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 97/182] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:21 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:22.411165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:22.413683 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:22.430739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:22.433531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:22.436630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:22.437169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:22.659977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:22.671603 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8be6705a-aa1f-42ad-9861-78d0fe1c49bf tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.271884 May 11 05:59:22.687296 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 86/183] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:22 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:22.751154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:22.753744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:22.773234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:22.773973 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:22.775452 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:22.776342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:22.941412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:22.951532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b7518d7e-a6ba-41a5-aad0-00dee8364898 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.204382 May 11 05:59:22.953300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 98/184] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:22 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:23.693733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:23.694375 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:23.703414 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:23.704126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:23.712427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:23.713051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:23.979288 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:23.980588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:23.990207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:23.990883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:23.991859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:23.992624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:24.074739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:24.086909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-68f699d8-b4ee-4663-8d3e-f76142106de4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.397763 May 11 05:59:24.099944 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 87/185] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:23 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:24.273169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:24.282061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ffc51380-dc7f-4466-ab5e-ada5608cf9fe tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.313609 May 11 05:59:24.283330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 99/186] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:23 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:25.105403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:25.106135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:25.118345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:25.119308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:25.133205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:25.140452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:25.298495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:25.300547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:25.314301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:25.314935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:25.315876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:25.316315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:25.481451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:25.491272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a2bba9e7-cfb0-47e5-a53e-99567addf0f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.390294 May 11 05:59:25.491851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 88/187] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:25 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:25.715444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:25.726463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f4109755-e2a8-4717-bcdb-bfd65a34c3e9 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.431899 May 11 05:59:25.736110 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 100/188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:25 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:26.509640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:26.510991 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:26.519298 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:26.519997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:26.520976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:26.521487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:26.683810 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:26.693510 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6f525dfa-4944-4069-9df2-607843722145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.188477 May 11 05:59:26.703854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 89/189] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:26 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:26.743873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:26.745377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:26.756398 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:26.757176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:26.758188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:26.758801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:26.985740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:26.993448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-06f49cb8-c02d-44fe-9667-5cac83746688 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.253701 May 11 05:59:27.003444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 101/190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:26 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:27.683205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5576a00d-3e6a-4a18-a801-d5d4bd229c31 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Action: 'create', calling method: .version_select at 0x7fa1402144c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-860430622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDi3II5kCdEdPRwUHtJId6XfcDFv9RN0kk0htCPLwW2Mns5P1WkmQqREkGfpU2E4gc5z+bAxW6Nb3Wl8/IsyqIPwtii2uHyhKRyk8o7o5MaKOKMpd1BD1oomc5D/KybwQ=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:27.698503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-5576a00d-3e6a-4a18-a801-d5d4bd229c31 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:27.702824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-5576a00d-3e6a-4a18-a801-d5d4bd229c31 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for user bbc14e1f89334e65b24fec7b4a321c5d and project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:27.710747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:27.712226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:27.720697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:27.721154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:27.722217 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:27.722681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:27.728107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5576a00d-3e6a-4a18-a801-d5d4bd229c31 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.274425 May 11 05:59:27.729077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 90/191] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 05:59:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:27.917761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:27.934635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d040428e-2344-4b90-8d3a-d13bd553376f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.227504 May 11 05:59:27.942017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 102/192] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:27 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:28.016537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:28.017457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:28.024503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:28.024955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:28.025758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:28.026560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:28.210918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:28.223193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-3db8faaa-42cb-48a0-b5d9-1960b6ec3489 req-b143c8d3-3bb1-49f0-be7f-b3d873c95946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "name": "network-vif-plugged", "status": "completed", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:28.225638 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a0ffff0b-d336-4625-b362-9c9610253268 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.218395 May 11 05:59:28.226753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 91/193] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:28 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:28.239272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-3db8faaa-42cb-48a0-b5d9-1960b6ec3489 req-b143c8d3-3bb1-49f0-be7f-b3d873c95946 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:28.240293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-3db8faaa-42cb-48a0-b5d9-1960b6ec3489 req-b143c8d3-3bb1-49f0-be7f-b3d873c95946 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:28.269837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-3db8faaa-42cb-48a0-b5d9-1960b6ec3489 req-b143c8d3-3bb1-49f0-be7f-b3d873c95946 service nova] Creating event network-vif-plugged:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 05:59:28.284579 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-3db8faaa-42cb-48a0-b5d9-1960b6ec3489 req-b143c8d3-3bb1-49f0-be7f-b3d873c95946 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066071 May 11 05:59:28.285633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 103/194] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:28.960978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:28.962372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:28.971032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:28.971551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:28.972499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:28.972942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:29.132221 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:29.140025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0bba90da-fd1c-481a-bd2d-c9b8d00fae97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.185250 May 11 05:59:29.141078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 92/195] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:28 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:29.244904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:29.245901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:29.254281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:29.254860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:29.255893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:29.256551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:29.455005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:29.464285 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-03623bb8-85a3-466a-9db5-c88a3c32e8c0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.224054 May 11 05:59:29.464879 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 104/196] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:29 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:30.157259 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:30.157977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:30.164127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:30.164667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:30.165770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:30.166326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:30.323114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:30.334128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-671b71c9-f9a9-4989-9d02-898917596b9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.180595 May 11 05:59:30.334724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 93/197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:30 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:30.482663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:30.483415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:30.489972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:30.490419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:30.491211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:30.491641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:30.633031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:30.641293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5b77ce6d-c7e1-4d92-8303-0947a1ffc643 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.162793 May 11 05:59:30.642091 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 105/198] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:30 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:31.351888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:31.352523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:31.359325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:31.359766 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:31.360526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:31.360957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:31.498465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:31.505694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-576f9442-e3bc-40f4-9fd1-fbdbb912f0c0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.157676 May 11 05:59:31.506269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 94/199] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:31 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:31.659633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:31.660345 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:31.666779 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:31.667315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:31.668166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:31.668751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:31.799884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:31.807276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4e2382e1-8bb1-4e02-87c4-075f38320459 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.153185 May 11 05:59:31.807858 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 106/200] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:31 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:32.524616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:32.525222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:32.531295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:32.531736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:32.532493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:32.532924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:32.671826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:32.679311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5f1a6f2a-5322-4661-b8ad-7784948bfd5f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.158533 May 11 05:59:32.679884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 95/201] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:32 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:32.824193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:32.824800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:32.832019 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:32.832677 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:32.835219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:32.836093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:32.985552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:32.993914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fcc4f064-9907-4154-90ee-f40700950ae7 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1359 microversion: 2.1 time: 0.173717 May 11 05:59:32.994484 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 107/202] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:32 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:33.696266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:33.696875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:33.703392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:33.703836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:33.704590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:33.705044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:33.838696 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:33.846374 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-350b86b1-72a0-490c-bbe6-082b9b2920c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.153970 May 11 05:59:33.846957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 96/203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:33 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:34.011606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:34.012214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:34.019735 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.020094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.020862 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.021296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.155432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:34.163006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a5370a8f-d34f-48a1-84e9-dfeb504d8a82 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1549 microversion: 2.1 time: 0.155186 May 11 05:59:34.165510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 108/204] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:34 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:34.181073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:34.181732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:34.188171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.188624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.189407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.189873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.402514 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:34.410951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-88643894-5ed7-49d5-925d-0fef60e29cde tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1549 microversion: 2.1 time: 0.233603 May 11 05:59:34.411616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 97/205] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:34 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1549 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:34.427676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:34.431106 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:34.435678 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Searching by: {'deleted': False, 'project_id': '4285af910bec40c4a5a5691d5492f941'} {{(pid=117335) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 05:59:34.446089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.446573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.447322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.447752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.552532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.multi_cell_list [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117335) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 05:59:34.650664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6497ac30-a479-4517-a0e7-ebb1d12b6533 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226955 May 11 05:59:34.651254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 109/206] 10.222.0.44 () {58 vars in 1124 bytes} [Wed May 11 05:59:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:34.661492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:34.662131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:34.667942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.668399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.669171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.670178 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.801273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:34.808791 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4b202def-fa2a-49ff-824a-2feb7628fca8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1549 microversion: 2.1 time: 0.150998 May 11 05:59:34.809293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 98/207] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:34 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:34.864181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:34.864932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:34.871047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.871500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:34.872283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:34.873236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:35.013400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:35.023574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e582e5fc-e0e3-4e9c-a11d-6b4828e1a5c2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.163614 May 11 05:59:35.024165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 110/208] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:34 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:35.429780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:35.430193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:35.436558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:35.437012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:35.437807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:35.438243 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:35.461077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-86517c1b-607a-44ef-bf81-a06628720d88 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/ips" status: 200 len: 149 microversion: 2.1 time: 0.035211 May 11 05:59:35.461668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 99/209] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 05:59:35 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:35.715448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:35.716056 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:35.723803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:35.724327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:35.725333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:35.725878 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:35.753317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1ecdc803-917c-4e29-a03c-3c2e48988dcb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/ips" status: 200 len: 153 microversion: 2.20 time: 0.041728 May 11 05:59:35.753977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 111/210] 10.222.0.44 () {60 vars in 1288 bytes} [Wed May 11 05:59:35 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 05:59:36.053249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:36.053249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:36.056112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:36.056568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:36.057347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:36.057814 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:36.212670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:36.220626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-339421c0-b9c8-4e8a-b1a1-6044d591ffc1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.182152 May 11 05:59:36.221576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 100/211] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:36 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:37.237226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:37.237872 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:37.244143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:37.244584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:37.245336 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:37.245818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:37.375773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:37.383324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a10f2b3b-880f-4ac2-952d-d69e77b24b97 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1521 microversion: 2.1 time: 0.149848 May 11 05:59:37.383892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 112/212] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:37 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:38.402087 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:38.403250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:38.409819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:38.410264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:38.411028 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:38.411459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:38.540273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:38.547550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1fdfd8bb-1a1d-40f6-8212-3b9f8d430d32 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1501 microversion: 2.1 time: 0.151371 May 11 05:59:38.548115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 101/213] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:38 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:38.563257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:38.563868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:38.570152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:38.570612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:38.571374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:38.571809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:38.705026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:38.712626 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca3eb909-8da0-4708-aa22-190df1a004bd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1514 microversion: 2.1 time: 0.153212 May 11 05:59:38.713209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 113/214] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:38 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:39.479446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "572cac7e-9f6f-47c8-8d81-88ecdbc2740e"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:39.480581 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:39.486484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:39.486937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:39.487706 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:39.488150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:39.816128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2ced5bd4-c546-4913-bbf6-3a515a4460e3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337515 May 11 05:59:39.816128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 102/215] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 05:59:39 2022] POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:39.958873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "427a6fb7-2891-423e-b270-456adba2c401"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:39.959984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:39.966920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:39.967362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:39.968119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:39.968548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:40.241011 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c12de362-c166-41ba-bccc-b24a0616909d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285789 May 11 05:59:40.242041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 114/216] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 05:59:39 2022] POST /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:41.003318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:41.003931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:41.010511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.010960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.011724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.012165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.035479 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lazy-loading 'flavor' on Instance uuid 276af0f1-c869-454b-ae66-454979121c15 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 05:59:41.305588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:41.314461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:41.329616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.330076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.334327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.334795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.362495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a78f1577-b209-4f5e-8377-a60539944fdf tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/action" status: 202 len: 0 microversion: 2.20 time: 0.364805 May 11 05:59:41.365521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 103/217] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 05:59:40 2022] POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 05:59:41.372248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:41.378442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'flavor' on Instance uuid d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 05:59:41.379323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:41.394485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.394971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.395753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.396185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.505390 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e5951c7a-9a12-475c-afd3-546d8c3f644f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/action" status: 200 len: 32 microversion: 2.1 time: 0.206281 May 11 05:59:41.506029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 115/218] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 05:59:41 2022] POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 05:59:41.516911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:41.517570 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:41.523600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.524051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.524827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:41.525237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:41.532284 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:41.540162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:41.541720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:41.542871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-eab47e8a-d7d2-45aa-a51f-4792588f2f71 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.174975 May 11 05:59:41.543435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 104/219] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:41 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:41.665090 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:41.673139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-997a98d7-b983-46ed-bbb7-cb47e541c037 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.161786 May 11 05:59:41.673903 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 116/220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:41 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:42.562970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:42.563552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:42.570010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:42.570502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:42.571285 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:42.571726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:42.691839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:42.692449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:42.712667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:42.713118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:42.714373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:42.714373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:42.734159 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:42.745935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:42.748153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:42.749388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5abd33d9-f28b-4d34-835e-82b61dbfd736 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.191802 May 11 05:59:42.750184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 105/221] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:42 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:42.854124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:42.862797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cda7a7b2-cb21-4cb3-838b-e45f96f7f7e1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.175769 May 11 05:59:42.863460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 117/222] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:42 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:43.768898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:43.770539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:43.777716 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:43.779251 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:43.780976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:43.781551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:43.884396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:43.885300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:43.895105 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:43.895552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:43.896532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:43.897264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:44.095674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:44.102433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:44.109101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:44.114152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:44.115188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6f7c60d1-0f94-4417-bf67-f0b23048f794 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.237416 May 11 05:59:44.116650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-762f165f-cbda-482b-92f2-915fc9de8243 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.352026 May 11 05:59:44.116837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 118/223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:43 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:44.117602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 106/224] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:43 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:45.139488 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:45.141177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:45.144326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:45.145842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:45.152689 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:45.155681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:45.156572 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:45.157019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:45.157980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:45.158640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:45.159667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:45.160305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:45.363603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:45.371225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-46cc9df0-95af-465c-b1fd-801daf243698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.236623 May 11 05:59:45.371876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 119/225] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:45 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:45.381305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:45.389651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:45.391483 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:45.392614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1ee89eb8-a0ac-46fb-96b0-ac50b3298e0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.257620 May 11 05:59:45.393173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 107/226] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:45 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:45.801784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1860052508", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "networks": [{"uuid": "47906bd0-63f9-491c-b0c1-1841c8a98974"}]}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:46.389635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:46.390257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:46.398094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:46.398699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:46.399654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:46.400102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:46.538100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:46.546050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6af8293c-9d85-4964-a473-76571815bf85 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.161240 May 11 05:59:46.546691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 108/227] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:46 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:46.551128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:46.551856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:46.557909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:46.558359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:46.559132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:46.559622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:46.699075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:46.707474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:46.708993 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:46.710191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8616d35d-177f-457f-97cf-805e7ab74b6e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.162587 May 11 05:59:46.710753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 109/228] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:46 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:47.563977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:47.564668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:47.570499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:47.570949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:47.571712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:47.572143 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:47.712612 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:47.719060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4c77bd2c-a511-43a7-811c-a47ef44a7323 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.159471 May 11 05:59:47.719647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 110/229] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:47 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:47.727702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:47.728308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:47.734843 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:47.735293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:47.736062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:47.736497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:47.887922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:47.897127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:47.898694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:47.899862 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3c7d9666-bd90-448b-9f47-3f78a4f01317 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.175835 May 11 05:59:47.900489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 111/230] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:47 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:48.547140 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:48.547773 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:48.553824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.554279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:48.555060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.555503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:48.686805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:48.694688 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-14ae4e29-0410-441a-b230-743169f811f5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1595 microversion: 2.1 time: 0.152067 May 11 05:59:48.695201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 112/231] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:48 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:48.735486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:48.736224 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:48.742366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.742825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:48.743588 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.744194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:48.915780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:48.921338 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2b3a8dcf-a729-4333-971b-70124e83c2ad tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.188781 May 11 05:59:48.928062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 113/232] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:48 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:48.933339 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:48.933989 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:48.940560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.941013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:48.941821 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:48.942299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:49.163277 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:49.171444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:49.172981 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:49.174166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4fa6a9c8-72c7-4f8b-a769-3789d01c13df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.245073 May 11 05:59:49.174718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 114/233] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:48 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:49.938774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:49.939413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:49.946396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:49.946852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:49.947647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:49.948083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:50.152434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:50.161794 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d0d13d9a-83b9-4fa4-9908-ab36fea59698 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.227958 May 11 05:59:50.162383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 115/234] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:49 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:50.196109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:50.196718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:50.202563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:50.203009 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:50.203775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:50.204209 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:50.671349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:50.680231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:50.682200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:50.683112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-87b22d44-6181-4eb6-bd71-46a647625ef2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.490955 May 11 05:59:50.683830 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 116/235] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:50 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:51.070722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-172cfda2-37b4-4777-8e9f-d817f5ad01e9 req-c0151ba5-f2e7-4120-a9bb-6d48e75dac18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:51.080038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-172cfda2-37b4-4777-8e9f-d817f5ad01e9 req-c0151ba5-f2e7-4120-a9bb-6d48e75dac18 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:51.080615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-172cfda2-37b4-4777-8e9f-d817f5ad01e9 req-c0151ba5-f2e7-4120-a9bb-6d48e75dac18 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:51.096693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-172cfda2-37b4-4777-8e9f-d817f5ad01e9 req-c0151ba5-f2e7-4120-a9bb-6d48e75dac18 service nova] Creating event network-changed:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 05:59:51.101944 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-172cfda2-37b4-4777-8e9f-d817f5ad01e9 req-c0151ba5-f2e7-4120-a9bb-6d48e75dac18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035446 May 11 05:59:51.102906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 117/236] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:59:51.187803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:51.192663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:51.201062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:51.201782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:51.202812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:51.203403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:51.461588 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:51.473031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-77833f70-4450-4acb-b915-e4c2daf5f075 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.297395 May 11 05:59:51.474085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 118/237] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:51 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:51.706763 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:51.708370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:51.722639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:51.723647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:51.727560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:51.728453 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:52.038998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:52.053220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:52.055050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:52.056238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c3df52cf-73fc-40c3-a008-312e32e4287d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.357279 May 11 05:59:52.057181 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 119/238] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:51 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:52.209742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-100966098"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:52.210358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:52.218182 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:52.218957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:52.219892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:52.220440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:52.365077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.network.security_group_api [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Adding security group b0958a3c-394f-4d46-a040-c0426f6f3bb1 to port 0ab1918d-6a5d-41ef-a74b-b96667049a93 May 11 05:59:52.802978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b660e072-11b8-4e22-94a1-38ce3c255031 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action" status: 202 len: 0 microversion: 2.1 time: 0.597164 May 11 05:59:52.803593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 120/239] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 05:59:52 2022] POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 05:59:52.810997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:52.811895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:52.818749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:52.819826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:52.821018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:52.821805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:52.986783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:52.994567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-32ea146e-3205-46d2-ac02-caaea6501c16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.189920 May 11 05:59:52.995719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 121/240] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:52 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:53.005171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:53.005808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:53.015480 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:53.016289 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:53.017198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:53.017822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:53.171931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:53.180701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8954d4f5-67e1-40f9-bf8c-a48e948eef71 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1760 microversion: 2.1 time: 0.179319 May 11 05:59:53.181620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 122/241] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:53 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:53.188428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:53.189315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:53.196886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:53.197747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:53.199975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:53.203794 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:53.346667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:53.354738 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:53.357032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:53.358288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1e7d9389-90e9-4dfd-b23c-5f32046fac6f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.175352 May 11 05:59:53.358863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 123/242] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:53 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:53.363355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-d9f4d4ee-a6ea-47db-b05b-08f94d469eac req-9837ff88-5059-4238-b9bb-364c060564c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:53.372599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d9f4d4ee-a6ea-47db-b05b-08f94d469eac req-9837ff88-5059-4238-b9bb-364c060564c9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:53.373538 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d9f4d4ee-a6ea-47db-b05b-08f94d469eac req-9837ff88-5059-4238-b9bb-364c060564c9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:53.385441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-d9f4d4ee-a6ea-47db-b05b-08f94d469eac req-9837ff88-5059-4238-b9bb-364c060564c9 service nova] Creating event network-changed:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 05:59:53.390516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-d9f4d4ee-a6ea-47db-b05b-08f94d469eac req-9837ff88-5059-4238-b9bb-364c060564c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030506 May 11 05:59:53.391694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 124/243] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:54.008151 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] validate_networks() for [('47906bd0-63f9-491c-b0c1-1841c8a98974', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:59:54.013369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:54.014308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:54.020948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.021419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.022293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.022767 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.184949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:54.197094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-25a5d9e5-8262-483b-bb55-b2fd327c9495 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.188602 May 11 05:59:54.197751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 125/244] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:54 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:54.370351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:59:54.370833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:59:54.371487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:59:54.372466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:59:54.372923 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:59:54.377300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:54.377955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:54.381892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.382357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.383263 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.383710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.384184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.384643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.385417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:54.385987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:54.404951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Getting quotas for project 3a889575293f48af826e9734868e2714. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:54.409153 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Getting quotas for user c054038efc2741ba951666abb68e1cf7 and project 3a889575293f48af826e9734868e2714. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:54.421139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:59:54.423773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:59:54.472226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3c58fbd7-e04b-4427-a7b9-446ccea47795 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.674601 May 11 05:59:54.472880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 120/245] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 8676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:59:54.482697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fa587063-5d8c-46a1-a3b4-7a324a8e85f8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:54.483307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fa587063-5d8c-46a1-a3b4-7a324a8e85f8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:54.522578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:54.531093 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:54.532670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:54.533888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-061d55e1-1663-49a5-8986-09352a728de1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.160399 May 11 05:59:54.534459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 126/246] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:54 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:54.537134 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fa587063-5d8c-46a1-a3b4-7a324a8e85f8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:54.544340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fa587063-5d8c-46a1-a3b4-7a324a8e85f8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1219 microversion: 2.1 time: 0.065625 May 11 05:59:54.544899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 121/247] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:54 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:55.216726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:55.217415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:55.223358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.223804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.224647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.225086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.371500 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:55.379903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4ab386b2-696f-4cff-913b-824bf06e9dd0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.168005 May 11 05:59:55.380494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 127/248] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:55 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:55.551890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:55.552494 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:55.560469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:55.560808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.561070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:55.561264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.562068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.562509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.567350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.567797 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.568562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:55.568987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:55.630463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:55.638597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9f7aad3d-3d8a-4cfb-afbd-32e5562da659 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1271 microversion: 2.1 time: 0.081674 May 11 05:59:55.639194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 128/249] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:55 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:55.693640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:55.702156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:55.703664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:55.704819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-38f07b93-6fbd-474a-aba2-10b8a4aeb333 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.156913 May 11 05:59:55.705377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 122/250] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:55 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:56.270930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-70990539-7b57-4f80-aedb-9e1ba70bdc3f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: .version_select at 0x7fa1401ec3a0>, body: {"keypair": {"name": "tempest-keypair-2079623409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3swSfyezDoqHlrF/KxNItaXfstGnh6P3tAS0tHt74IAc5DD00SzHlx9DeCyEUJ5G0Tk490EHBWK6Nc8RC2pYtwZleoC/CvmW2nroV340DEzf5ULIOiKfIWfL3xXei/Ow=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:56.285396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-70990539-7b57-4f80-aedb-9e1ba70bdc3f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:56.289164 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-70990539-7b57-4f80-aedb-9e1ba70bdc3f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:56.310787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-70990539-7b57-4f80-aedb-9e1ba70bdc3f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044526 May 11 05:59:56.311686 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 129/251] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 05:59:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:56.399460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:56.400411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:56.406861 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.407308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.408082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.408766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.572338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:56.580476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-12846ba6-48b2-400d-8c61-3f2ed3046c76 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.186017 May 11 05:59:56.581094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 123/252] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:56 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:56.661166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:56.662376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:56.673872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.674606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.675940 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.676439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.725198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:56.726619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:56.734335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.734786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.735598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:56.736273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:56.927175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:56.935803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-981306a7-f87d-4315-8f18-b71c1f842527 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.282775 May 11 05:59:56.936502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 130/253] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:56 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:56.938809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:56.946977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:56.948762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:56.950286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-690f8008-f653-41ce-9c5d-6f462debf99b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.229625 May 11 05:59:56.951026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 124/254] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:56 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:57.549258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-ce55603a-fd9f-4774-87f1-125ca6a93db2 req-4f6c0927-c385-402b-9823-76242cb85839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62149b5e-614b-41ef-9fda-7bf2b5175152", "tag": "a8ed2477-82f2-43ee-bbb9-7f2f47a66b02"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:57.557429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-ce55603a-fd9f-4774-87f1-125ca6a93db2 req-4f6c0927-c385-402b-9823-76242cb85839 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.557957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-ce55603a-fd9f-4774-87f1-125ca6a93db2 req-4f6c0927-c385-402b-9823-76242cb85839 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.570680 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-ce55603a-fd9f-4774-87f1-125ca6a93db2 req-4f6c0927-c385-402b-9823-76242cb85839 service nova] Creating event network-changed:a8ed2477-82f2-43ee-bbb9-7f2f47a66b02 for instance 62149b5e-614b-41ef-9fda-7bf2b5175152 on hv-cinder-73362 May 11 05:59:57.577378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-ce55603a-fd9f-4774-87f1-125ca6a93db2 req-4f6c0927-c385-402b-9823-76242cb85839 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031356 May 11 05:59:57.579320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 131/255] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 05:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 05:59:57.598928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:57.599710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:57.608547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.609009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.609831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.610280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.624973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:57.625578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:57.631684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.632283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.633591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.634190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.658899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9976cd7c-2d18-450d-a27a-e097d9625a34 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/ips" status: 200 len: 146 microversion: 2.1 time: 0.038757 May 11 05:59:57.659484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 132/256] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 05:59:57 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 05:59:57.792550 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:57.800684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-db82e06b-348a-413a-8986-37c156fddb90 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.206736 May 11 05:59:57.805564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 125/257] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:57 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:57.953811 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:57.954337 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:57.963185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.963927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.966005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.967166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.972640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:57.973273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:57.986107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.986969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:57.987956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:57.988596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:58.133616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:58.143582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:58.145124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:58.146326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5ce98f3e-dfa4-4463-a97d-75d9e7ea667c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.178394 May 11 05:59:58.146896 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 126/258] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:57 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 05:59:58.152375 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-435008732", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dde216-4b2f-4353-ba38-412714627bb9"}], "security_groups": [{"name": "tempest-securitygroup--1048495139"}], "key_name": "tempest-keypair-2079623409", "user_data": "}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 05:59:58.264183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] validate_networks() for [('28dde216-4b2f-4353-ba38-412714627bb9', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 05:59:58.281130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:58.288659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5832128a-5d98-45de-9bb4-1973e19886f1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.340273 May 11 05:59:58.289228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 133/259] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:57 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:58.630322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 05:59:58.630786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 05:59:58.631214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 05:59:58.631624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 05:59:58.632037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 05:59:58.641870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:58.642324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:58.643134 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:58.643584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:58.661283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 05:59:58.665101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 05:59:58.677291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 05:59:58.679641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 05:59:58.739528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b335637f-94ab-415e-8b5a-2a54e4b789b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.591532 May 11 05:59:58.740180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 127/260] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 05:59:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 05:59:58.751715 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-302a90f2-4fac-4f91-9f10-faf2352745d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:58.752400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-302a90f2-4fac-4f91-9f10-faf2352745d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:58.810902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-302a90f2-4fac-4f91-9f10-faf2352745d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:58.817993 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-302a90f2-4fac-4f91-9f10-faf2352745d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1241 microversion: 2.1 time: 0.070240 May 11 05:59:58.818228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:58.818860 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 134/261] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:58 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 05:59:58.821816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:58.834709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:58.834992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:58.835864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:58.836326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:58.994482 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.008108 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8dea551d-937b-4df2-83e9-66d7166394fd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.193613 May 11 05:59:59.008885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 128/262] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:58 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:59.167097 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:59.167699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:59.176631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.177083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.178319 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.178765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.306368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:59.311112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:59.313454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.313951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.314729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.315169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.326563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.344586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.346152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.347379 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-da64a9f7-2559-4308-b086-a27c040658f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.184192 May 11 05:59:59.347925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 135/263] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 05:59:59 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 05:59:59.454958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.463367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f64fd756-4281-4407-a8fb-35a40797947a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.161613 May 11 05:59:59.464233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 129/264] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:59 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 05:59:59.836178 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 05:59:59.836783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 05:59:59.843551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.844006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.844775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 05:59:59.845213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 05:59:59.919169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 05:59:59.931951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-16b1808b-5ce7-4c21-aeca-f31c0f737837 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1245 microversion: 2.1 time: 0.099353 May 11 05:59:59.937250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 136/265] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 05:59:59 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:00.032554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:00.033972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:00.041736 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.042337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.043478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.044032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.224608 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:00.233589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7e2ad539-8078-43d5-a570-4c7e0e43a1e9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.205915 May 11 06:00:00.234371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 130/266] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:00 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:00.370001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:00.370555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:00.377959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.378415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.379191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.379630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.481031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:00.482408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:00.488444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.488894 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.489703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.490140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.511327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:00.519516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:00.521036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:00.522236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a47dc235-6531-427f-927f-f95d219dbe38 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.157330 May 11 06:00:00.522806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 137/267] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:00 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:00.622696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:00.631117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c658b3ed-043f-403c-ae52-af0df65a8961 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.154023 May 11 06:00:00.631710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 131/268] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:00 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:00.951760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:00.952290 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:00.958457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.958907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:00.959686 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:00.960122 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.020134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.027726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-769d0b71-385d-4663-9936-815c8efe36bb tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1293 microversion: 2.1 time: 0.080781 May 11 06:00:01.029041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 138/269] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:00 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:01.251812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:01.253047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:01.260827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.261349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.263067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.263567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.426008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.435827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0bf34bab-8c2c-4d8f-a611-ff66880173b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.188952 May 11 06:00:01.437875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 132/270] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:01 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:01.446070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1989019752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860430622", "security_groups": [{"name": "tempest-secgroup-smoke-1626878111"}], "block_device_mapping_v2": [{"uuid": "d7da24b9-012e-49be-a60d-999c5cf03a3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c2135e5-d24e-4b23-bdbc-168d1955897d"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:01.540305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:01.540948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:01.547074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.547524 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.548498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.549242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.614135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] validate_networks() for [('1c2135e5-d24e-4b23-bdbc-168d1955897d', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:00:01.684529 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.692487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.694039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.695182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-719dcf5e-cef0-4692-9410-b5fb5dfc26cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.159003 May 11 06:00:01.696111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 133/271] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:01 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:01.701024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:01.701655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:01.707483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.707938 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.708710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.709150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.837040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:01.845005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0e279bd3-10cc-457f-a998-7ba8e97d4923 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.147948 May 11 06:00:01.845598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 134/272] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:01 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:01.980190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:00:01.980620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:00:01.981733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:00:01.982154 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:00:01.982654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:00:01.991460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.991911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:01.992718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:01.993158 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.010691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:00:02.015599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for user bbc14e1f89334e65b24fec7b4a321c5d and project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:00:02.045977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:02.046714 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.052508 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.053044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.054003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.054496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.075735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:00:02.077988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7da24b9-012e-49be-a60d-999c5cf03a3d',volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:00:02.123942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.132726 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e3cb23ad-c2e6-4fc6-a19e-d2d6915c706f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1301 microversion: 2.1 time: 0.090607 May 11 06:00:02.143375 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 135/273] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:02 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:02.223737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c1704377-14ec-4664-8377-c316b3d93177 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781000 May 11 06:00:02.224768 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 139/274] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:00:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:00:02.235684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0f166456-951c-4ec3-aaf0-7a58ca07ada9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:02.236520 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0f166456-951c-4ec3-aaf0-7a58ca07ada9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.308812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0f166456-951c-4ec3-aaf0-7a58ca07ada9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.318129 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0f166456-951c-4ec3-aaf0-7a58ca07ada9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1094 microversion: 2.1 time: 0.087371 May 11 06:00:02.318725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 136/275] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:02 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:02.453757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:02.454379 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.461812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.462271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.463049 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.463485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.482995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7741bf15-1936-4ed9-8ed8-052c1ce57c09"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:02.484371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.502791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.503100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.503919 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.504697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.694376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.718380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-531002bd-9e47-4152-800b-d9e68cbda9b2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1500 microversion: 2.1 time: 0.267808 May 11 06:00:02.719562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 140/276] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:02 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:02.729194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:02.731644 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.743007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.744704 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.745925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.746419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.914648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.924384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.925937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:02.927111 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8ecba1ff-e720-45c9-b3dd-ccc4d46357d8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.206369 May 11 06:00:02.927675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 141/277] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:02 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:02.932743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fa62689-36b7-4707-bd23-fba87b88776b"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:02.934167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.940917 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.941447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.942341 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.942783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.946221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-77f076ed-f7bc-4cf9-9419-d4f75234da1f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.468614 May 11 06:00:02.946860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 137/278] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:00:02 2022] POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:02.955587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:02.956298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.962476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.962934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.963712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.964149 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.970673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] HTTP exception thrown: Cannot 'attach_volume' instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca while it is in vm_state rescued May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Request method failure captured: May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/os-volume_attachments HTTP/1.1 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 74 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1B21o_mpixF3E4vzUVPu6SH0Cex_RVyY9WP2Vv_dzgqFim6zWZ62yKSyx-LSyOczH5Aslqn5zoGxK946bIE9W5sCJvgPEY88T--15dCfBiVlrjuKSEW5VxEmCiUoTChZpnKojdkjPg7ejMdmvgG2GWVIJjr8Jt9AOF9rBHp10j8Zu0 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:00:02.971177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}] May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 28c76d12b0b1436d8eb0b23acf252f25 May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {"volumeAttachment": {"volumeId": "3fa62689-36b7-4707-bd23-fba87b88776b"}} May 11 06:00:02.972420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Cannot 'attach_volume' instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca while it is in vm_state rescued May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'server_id': 'd45d7dad-15ad-4274-ab0c-6c7c4a6f9bca', 'body': {'volumeAttachment': {'volumeId': '3fa62689-36b7-4707-bd23-fba87b88776b'}}} May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:00:02.973083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca while it is in vm_state rescued May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:00:02.974465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca while it is in vm_state rescued May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Returning 409 to user: Cannot 'attach_volume' instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca while it is in vm_state rescued {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7e94dd21-d63a-4f4c-8b83-78c303a55565 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043912 May 11 06:00:02.975555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 142/279] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:00:02 2022] POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 06:00:02.983004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:02.983543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:02.990152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.990484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:02.991265 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:02.991703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.063208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5dc32a79-c9a8-4446-8246-de79371dbaeb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/action" status: 202 len: 0 microversion: 2.1 time: 0.084898 May 11 06:00:03.063974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 143/280] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:00:02 2022] POST /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:00:03.072542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:03.073507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:03.080575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.081107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.081975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.082474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.108922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:03.117653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0f7b7b36-ef75-41e1-b597-75f3bda8b0fd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.169438 May 11 06:00:03.118238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 138/281] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:02 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:03.151053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:03.151701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:03.158272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.158721 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.159486 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.159918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.221330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:03.225776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:03.229296 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e0f0562e-3f4b-4a4a-b671-c247d7cb7bc8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1508 microversion: 2.1 time: 0.160955 May 11 06:00:03.229904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 144/282] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:03 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:03.233504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1d21298b-f285-4d9a-a4ec-3a5a2c29372f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1299 microversion: 2.1 time: 0.086543 May 11 06:00:03.234220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 139/283] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:03 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:03.335320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:03.335857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:03.342495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.342952 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.343723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.344167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.406628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:03.413913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-aae5a17a-ab3f-4f7a-aa1d-2d0c1eaef0b5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1136 microversion: 2.1 time: 0.082573 May 11 06:00:03.414517 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 145/284] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:03 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:03.946026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:03.946794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:03.953660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.954139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:03.954961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:03.955391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.095036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.102803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.104315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.105495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3e3e7eb7-4bfb-47b0-a38e-9b441da01d7c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.163609 May 11 06:00:04.106900 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 140/285] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:03 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:04.134628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:04.135481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:04.143753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.144202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.144966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.145400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.248982 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:04.249873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:04.264861 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.265737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.267888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.268485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.300347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.308300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-44ea88e3-d2f5-42bd-9837-13ac258730ba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.177833 May 11 06:00:04.317441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 146/286] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:04 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:04.317441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:04.317441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:04.322145 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.322592 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.323368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.323804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.387834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.395772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-97cfe32f-b0e6-47ee-8d4d-56dd18c7b809 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1299 microversion: 2.1 time: 0.083862 May 11 06:00:04.396906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 147/287] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:04 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:04.431306 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:04.431916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:04.438536 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.438995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.439768 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:04.440205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:04.474009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.488754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-78c8ee89-8762-41b0-9f49-bf02cb33f6f8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1508 microversion: 2.1 time: 0.244731 May 11 06:00:04.490590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 141/288] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:04 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:04.506493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:04.514756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-91422289-534f-4fe2-9fa1-96156caa29ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1192 microversion: 2.1 time: 0.087341 May 11 06:00:04.515327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 148/289] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:04 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:05.128486 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:05.129110 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:05.158075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.160107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.161599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.162189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.324976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:05.326299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:05.334248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.334983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.335966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.336600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.564140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.574253 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.577859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.579647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b6263789-3721-45f5-ac5c-e5af52b34b3a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1745 microversion: 2.20 time: 0.458208 May 11 06:00:05.582702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.593854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 142/290] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:05 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1745 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:05.600514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:05.601192 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4cb79e9a-00e0-4e2f-974c-3adac94ba6b3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.278975 May 11 06:00:05.601653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:05.611956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 149/291] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:05 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:05.624460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.624851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:05.625317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.625573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:05.626421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.627024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.631817 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.632466 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.636238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.638086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.795423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.806091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-255fee9e-27a5-49fb-92d7-3669b32944ff tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1508 microversion: 2.1 time: 0.188920 May 11 06:00:05.817219 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 150/292] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:05 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:05.822474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:05.823321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:05.830702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.831160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.831941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:05.832376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:05.906971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:05.915102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-82ecd88a-a94b-415c-99eb-cd8e951c775a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1210 microversion: 2.1 time: 0.096487 May 11 06:00:05.915669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 151/293] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:05 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:06.020335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.028568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-11a8a720-b3d8-4d15-8aed-558d30de2797 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.433225 May 11 06:00:06.029322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 143/294] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:05 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:06.603349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:06.606637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:06.616089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.616747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.617728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.618313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.622482 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:06.623301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:06.633936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.636389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.637831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.639041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.780487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.789570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.791366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.792778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2f2475df-4227-4fc0-9098-5bdee1d7fe14 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1745 microversion: 2.20 time: 0.197931 May 11 06:00:06.793817 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 152/295] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:06 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:06.800927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-19793e75-6ded-4861-9602-f95c025e5732 req-1679a6a4-60e2-45db-81da-adf320c546eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f582d9e6-0bc1-47e8-9500-9c7501f659ac", "tag": "034c673a-cd22-42e5-bff2-855d7907c09a"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:06.809748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-19793e75-6ded-4861-9602-f95c025e5732 req-1679a6a4-60e2-45db-81da-adf320c546eb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.810422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-19793e75-6ded-4861-9602-f95c025e5732 req-1679a6a4-60e2-45db-81da-adf320c546eb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.815868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.822507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-19793e75-6ded-4861-9602-f95c025e5732 req-1679a6a4-60e2-45db-81da-adf320c546eb service nova] Creating event network-changed:034c673a-cd22-42e5-bff2-855d7907c09a for instance f582d9e6-0bc1-47e8-9500-9c7501f659ac on hv-cinder-73362 May 11 06:00:06.826018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6d40be98-7474-4f4d-8009-0cb98dbee5c1 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.208835 May 11 06:00:06.827189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 144/296] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:06 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:06.829640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-19793e75-6ded-4861-9602-f95c025e5732 req-1679a6a4-60e2-45db-81da-adf320c546eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034444 May 11 06:00:06.830932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 153/297] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:06.835149 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:06.836462 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:06.843614 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.844271 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.845222 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.845866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.932395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:06.933206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:06.939581 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.940108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.940945 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:06.941438 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:06.980364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:06.987989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9a9c848c-5613-4dc8-9748-0b99e379e35f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1508 microversion: 2.1 time: 0.159212 May 11 06:00:06.988666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 145/298] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:06 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:07.046633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:07.047565 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:07.053786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.054235 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.055176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.055617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.080069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.087460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dfcd16cd-b238-4a89-9d69-7f2becf0095e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.159091 May 11 06:00:07.088033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 154/299] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:06 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:07.191897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.199018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9637c9e6-4585-4c8e-a465-ea8d9fd861cd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.157300 May 11 06:00:07.199621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 146/300] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:07 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:07.812406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:07.813015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:07.819582 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.820030 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.820793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.821228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.842368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:07.842978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:07.849319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.849789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.850562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:07.850996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:07.954013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.961961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.963458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.964613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-72331bb2-f218-46dc-843e-55343b631fd2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1745 microversion: 2.20 time: 0.156708 May 11 06:00:07.966098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 155/301] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:07 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:07.980012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:07.987890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-157a4f57-07e8-42c6-89fd-5d6c6eb55e08 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.149377 May 11 06:00:07.988445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 147/302] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:07 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:08.005735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:08.006341 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:08.012463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.012910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.013700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.014133 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.105010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:08.106585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:08.113426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.113921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.114744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.115155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.147502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:08.155977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-54dd6d68-ad6b-49a6-aa6e-a607daea956d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1508 microversion: 2.1 time: 0.154075 May 11 06:00:08.156772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 156/303] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:08 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:08.217191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:08.217978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:08.224073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.224597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.225436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.225958 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.250507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:08.258693 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fb56d47a-a17b-494a-aeac-fa912311ced1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.157955 May 11 06:00:08.264185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 148/304] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:08 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:08.368912 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:08.376571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d0d142ae-413c-4151-94e9-7d783c91f961 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.164221 May 11 06:00:08.377145 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 157/305] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:08 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:08.775403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-388ee89b-fd44-4d11-bf3a-98ff7b1bccfd req-57a2bc96-2f8b-4291-97e6-10531de0c6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62149b5e-614b-41ef-9fda-7bf2b5175152", "name": "network-vif-plugged", "status": "completed", "tag": "a8ed2477-82f2-43ee-bbb9-7f2f47a66b02"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:08.784817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-388ee89b-fd44-4d11-bf3a-98ff7b1bccfd req-57a2bc96-2f8b-4291-97e6-10531de0c6a9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.785516 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-388ee89b-fd44-4d11-bf3a-98ff7b1bccfd req-57a2bc96-2f8b-4291-97e6-10531de0c6a9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.798431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-388ee89b-fd44-4d11-bf3a-98ff7b1bccfd req-57a2bc96-2f8b-4291-97e6-10531de0c6a9 service nova] Creating event network-vif-plugged:a8ed2477-82f2-43ee-bbb9-7f2f47a66b02 for instance 62149b5e-614b-41ef-9fda-7bf2b5175152 on hv-cinder-73362 May 11 06:00:08.803802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-388ee89b-fd44-4d11-bf3a-98ff7b1bccfd req-57a2bc96-2f8b-4291-97e6-10531de0c6a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032767 May 11 06:00:08.804972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 149/306] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:08.984720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:08.985172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:08.991589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.992264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:08.993401 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:08.994010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.006826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:09.008039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:09.019756 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.020207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.020990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.021423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.195414 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.204856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.206772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.207941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-40e6a04c-c090-4c3e-9bbd-7b07d2b4be96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1745 microversion: 2.20 time: 0.228134 May 11 06:00:09.209601 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 158/307] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:08 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:09.216120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:09.216953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:09.224312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.224764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.225825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.226462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.404367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.409853 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.414349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ff675d70-c1ce-4074-9db0-a832dd847984 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.412405 May 11 06:00:09.414805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 150/308] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:08 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:09.418577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-69a09167-571c-466c-9f74-b1f15633504d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1514 microversion: 2.1 time: 0.208060 May 11 06:00:09.419185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 159/309] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:09 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:09.420981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:09.421897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:09.424498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:09.428172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.428876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.430579 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.431228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.434759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:09.454564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.455520 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.456349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.456907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.661224 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.684193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8ebf35f0-80b3-4a2e-bfc0-841e96b09c74 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.260668 May 11 06:00:09.684929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 160/310] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:09 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:09.906113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:09.913570 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5c07d987-7e7c-4c92-95dc-801eceeca75f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.497339 May 11 06:00:09.914147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 151/311] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:09 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:09.953702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-f58c76e4-630e-4f22-b922-e956a1fb7973 req-d03aea24-3535-45ab-b007-fdee96c89605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56072492-2dc2-4297-81ad-5f56dd97e54a", "tag": "7bedeb63-cb08-4227-a110-028c3175d7d0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:09.961803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-f58c76e4-630e-4f22-b922-e956a1fb7973 req-d03aea24-3535-45ab-b007-fdee96c89605 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:09.962169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-f58c76e4-630e-4f22-b922-e956a1fb7973 req-d03aea24-3535-45ab-b007-fdee96c89605 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:09.973520 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-f58c76e4-630e-4f22-b922-e956a1fb7973 req-d03aea24-3535-45ab-b007-fdee96c89605 service nova] Creating event network-changed:7bedeb63-cb08-4227-a110-028c3175d7d0 for instance 56072492-2dc2-4297-81ad-5f56dd97e54a on hv-cinder-73362 May 11 06:00:09.978332 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-f58c76e4-630e-4f22-b922-e956a1fb7973 req-d03aea24-3535-45ab-b007-fdee96c89605 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028542 May 11 06:00:09.979708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 161/312] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:10.227416 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:10.228192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:10.235866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.236332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.237104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.237561 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.373053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:10.380818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:10.382541 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:10.383706 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c548bfdc-38fa-4e8f-a2fb-e3a2fa0d5e1b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1745 microversion: 2.20 time: 0.160334 May 11 06:00:10.384261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 152/313] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:10 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:10.430052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:10.430780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:10.437012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.437491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.438252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.438690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.568524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:10.577395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3dd5e20a-4198-432e-a5b1-1d3ef7b32ed3 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1319 microversion: 2.1 time: 0.151512 May 11 06:00:10.586980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 162/314] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:10 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:10.701711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:10.702242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:10.709034 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.709721 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.710491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.710927 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.793239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-69ffbf7a-89bc-4dfa-b102-68a45b1d4660 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: .version_select at 0x7fa14041b820>, body: {"keypair": {"name": "tempest-keypair-178112507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFI6K3sK7BKdGFKHQTl9SV3yIQjZECmGkfPlf5Qes+ZjTMhm9l6i7LZfvAue6NiLVdDH4SquifwQPYJziBsyJC6UIBoN3iegE4aHhaZggQ9vrrAgzYxLw1VTS2I+lH9xGQ=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:10.807597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-69ffbf7a-89bc-4dfa-b102-68a45b1d4660 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:00:10.811690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-69ffbf7a-89bc-4dfa-b102-68a45b1d4660 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for user 28c76d12b0b1436d8eb0b23acf252f25 and project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:00:10.842659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-69ffbf7a-89bc-4dfa-b102-68a45b1d4660 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053337 May 11 06:00:10.843281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 163/315] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 06:00:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:10.847860 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-e549d42f-afba-43e0-ae4f-5f2c999c4ed1 req-2d859db0-eb72-4793-9dda-8b19f74be451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "name": "network-vif-plugged", "status": "completed", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:10.858791 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-e549d42f-afba-43e0-ae4f-5f2c999c4ed1 req-2d859db0-eb72-4793-9dda-8b19f74be451 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.859360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-e549d42f-afba-43e0-ae4f-5f2c999c4ed1 req-2d859db0-eb72-4793-9dda-8b19f74be451 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.870682 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-e549d42f-afba-43e0-ae4f-5f2c999c4ed1 req-2d859db0-eb72-4793-9dda-8b19f74be451 service nova] Creating event network-vif-plugged:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 06:00:10.877267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-e549d42f-afba-43e0-ae4f-5f2c999c4ed1 req-2d859db0-eb72-4793-9dda-8b19f74be451 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032832 May 11 06:00:10.878349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 164/316] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:10.932098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:10.932900 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:10.940511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.941042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.941915 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:10.942420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:10.944064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:10.952836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-47f903ee-c155-4aab-89bd-94c841c5b6ca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.255468 May 11 06:00:10.953590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 153/317] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:10 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:11.094853 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:11.102654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1f6c05e8-2070-40c5-a9a2-504884ceca4d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.175215 May 11 06:00:11.103431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 165/318] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:10 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:11.401657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:11.402392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:11.410129 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.410688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:11.411602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.412131 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:11.595174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:11.595785 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:11.602270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.602652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:11.603602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.604043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:11.621006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:11.630046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:11.632005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:11.633384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d63dbdf9-76b1-48b4-aa7f-b06538598769 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.235726 May 11 06:00:11.634187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 154/319] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:11 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:11.747628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:11.756561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5a675af2-18e9-4c51-a7f1-8822f77b459e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1508 microversion: 2.1 time: 0.165207 May 11 06:00:11.764838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 166/320] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:11 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:11.969900 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:11.970684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:11.977705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.978160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:11.978930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:11.979366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:12.120389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:12.122121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:12.128867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:12.129604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:12.130383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:12.131023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:12.199625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:12.213575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-05ddb712-b4eb-4202-821b-b9aec937dcae tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.244898 May 11 06:00:12.223989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 155/321] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:11 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:12.312614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:12.321184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-93b91f94-a43b-477c-a202-da843c83cb90 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.204740 May 11 06:00:12.322014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 167/322] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:12 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:12.584682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1699178250", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b62a26f9-5853-46d1-925a-762af9a689ba"}], "security_groups": [{"name": "tempest-securitygroup--237759243"}], "key_name": "tempest-keypair-178112507", "user_data": "}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:12.653314 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:12.653967 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:12.660511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:12.660990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:12.661780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:12.662216 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:12.691371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] validate_networks() for [('b62a26f9-5853-46d1-925a-762af9a689ba', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:00:12.817630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:12.850632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:12.853442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:12.855010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-964ce4a4-812d-4273-a52e-e255f74cdcc6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.206728 May 11 06:00:12.858696 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 168/323] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:12 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:13.231093 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:13.232113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:13.241334 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.242163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.243132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.243719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.329457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:00:13.329914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:00:13.330396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:00:13.330809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:00:13.331229 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:00:13.346687 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.347144 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.347977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.348410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.375780 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:00:13.381158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Getting quotas for user 28c76d12b0b1436d8eb0b23acf252f25 and project 8d84ee8b78144447bef24d677ad32b3c. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:00:13.396716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:00:13.399256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:00:13.438273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:13.446839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9f7828e9-0876-46e2-8a1c-bea4c129189a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.220275 May 11 06:00:13.460207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 169/324] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:13 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:13.466718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:13.467659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:13.474163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.474844 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.475776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.476370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.481911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-39a971aa-5f20-4aaf-9eca-70b113105fa6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.900137 May 11 06:00:13.482529 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 156/325] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:00:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:00:13.498020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cde5e802-9a64-44ae-bf67-04d91bb80849 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:13.500367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cde5e802-9a64-44ae-bf67-04d91bb80849 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:13.626924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cde5e802-9a64-44ae-bf67-04d91bb80849 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:13.639512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cde5e802-9a64-44ae-bf67-04d91bb80849 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1245 microversion: 2.1 time: 0.149189 May 11 06:00:13.640027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 157/326] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:13 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1245 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:13.727986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:13.739580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0e17e4c2-d36d-4f61-a19b-313756624c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1278 microversion: 2.1 time: 0.277941 May 11 06:00:13.740399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 170/327] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:13 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1278 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:13.825113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-815f3a61-5e62-42bd-9c5f-d0f026decb3a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:13.831469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-815f3a61-5e62-42bd-9c5f-d0f026decb3a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.831930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-815f3a61-5e62-42bd-9c5f-d0f026decb3a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.879606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:13.880605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:13.889157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.890038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.891656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.892255 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:13.911457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-815f3a61-5e62-42bd-9c5f-d0f026decb3a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Going to try to stop instance {{(pid=117335) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 06:00:13.973119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-815f3a61-5e62-42bd-9c5f-d0f026decb3a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action" status: 202 len: 0 microversion: 2.1 time: 0.158647 May 11 06:00:13.977088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 158/328] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:00:13 2022] POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:00:13.988518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:13.989899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:13.997605 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:13.998071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.000121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.000574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.141622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.157953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.160834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.170846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f49054e2-12a2-4cff-8f94-fec05e002ddc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.298003 May 11 06:00:14.171797 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 171/329] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:13 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:14.260993 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.271106 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0d708e76-7cfe-45dd-8497-17d74f1fe93b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.291501 May 11 06:00:14.273326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 159/330] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:13 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:14.467261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:14.467879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:14.477916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.479643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.480747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.484883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.668520 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:14.669897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:14.678842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.679484 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.680435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.681027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.783952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.797311 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7b00739f-6e3d-45bb-9e08-ce0492e78792 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1241 microversion: 2.1 time: 0.133805 May 11 06:00:14.798301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 160/331] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:14 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1241 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:14.810368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:14.811627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:14.812460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:14.819497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.820322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.821286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:14.823758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-82fa9c12-2f1a-4ea0-8f4e-f98e874c6876 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.361006 May 11 06:00:14.828208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 172/332] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:14 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:14.834307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:14.991238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:15.000156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-257a9b78-6e73-467c-9c33-f0c37bae41d4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.200482 May 11 06:00:15.001195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 161/333] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:14 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:15.196954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:15.198107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:15.212254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.214132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.216452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.217838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.289226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:15.290291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:15.306870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.307369 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.308203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.308788 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.544220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:15.558299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:15.562284 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:15.563721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-89272c1d-8532-4117-8917-e8d917262491 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.372937 May 11 06:00:15.575210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 173/334] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:15 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:15.593630 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:15.604937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-35521df2-8727-4889-9b33-6ba9061591c6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.319522 May 11 06:00:15.614361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 162/335] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:15 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:15.838130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:15.839439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:15.847704 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.858050 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:15.858715 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:15.866077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.879407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.879863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.880653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.881085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:15.894941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:15.897204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.064927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.075499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-29b2cab3-57ad-4566-b60e-c965b5b29aa2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1305 microversion: 2.1 time: 0.252999 May 11 06:00:16.076352 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 174/336] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:15 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1305 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:16.096089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:16.096873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:16.120692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.122498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.124224 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.125855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.171259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.190781 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-95b225ca-ee1e-4865-bc0c-6e785353eee0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.338925 May 11 06:00:16.191390 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 163/337] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:15 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:16.353649 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.369329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6c0e0d97-a776-491c-bc30-481d4a408773 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.290911 May 11 06:00:16.370896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 175/338] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:16 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:16.581987 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:16.582589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:16.590559 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.591985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.594536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.596610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.623880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:16.624782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:16.633645 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.638348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.639190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:16.639633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:16.882919 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.890266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.895765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-694e678f-042f-4887-a590-d16309f2465a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.276173 May 11 06:00:16.901058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 176/339] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:16 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:16.902156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.903712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:16.906765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c707fa0c-a8ea-42a0-943a-25cf76a70115 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.328609 May 11 06:00:16.908160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 164/340] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:16 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:17.104641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:17.104849 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:17.128622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.128622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.129431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.136242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.207738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:17.208350 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:17.217843 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.231588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.232531 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.233080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.372228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:17.382360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8f838757-4bcb-4afb-b794-8fb30a4a8ca6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.289247 May 11 06:00:17.393935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 177/341] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:17 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:17.399119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:17.399679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:17.407045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.407498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.408336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.408985 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.540830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:17.555748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-170eea84-deb7-468e-86b4-c074830a903d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.352233 May 11 06:00:17.558255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 165/342] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:17 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:17.647562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:17.660185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e75df079-96eb-4533-93c4-bf9df9e5966b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.264819 May 11 06:00:17.661519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 178/343] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:17 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:17.924022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:17.925604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:17.925771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:17.931403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:17.951395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.951851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.952635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.953069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.960770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.967147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:17.968725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:17.969283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:18.326796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:18.344063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:18.346477 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:18.347712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4149a69f-235c-4290-8feb-333fef744cb6 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.425894 May 11 06:00:18.349550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 179/344] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:17 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:18.363085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-863a7731-eac3-4609-8351-40ca1cad5ab2 req-1b27500b-0084-454c-86d6-b1781324ff7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f582d9e6-0bc1-47e8-9500-9c7501f659ac", "name": "network-vif-plugged", "status": "completed", "tag": "034c673a-cd22-42e5-bff2-855d7907c09a"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:18.399300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-863a7731-eac3-4609-8351-40ca1cad5ab2 req-1b27500b-0084-454c-86d6-b1781324ff7d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:18.400392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-863a7731-eac3-4609-8351-40ca1cad5ab2 req-1b27500b-0084-454c-86d6-b1781324ff7d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:18.425886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-863a7731-eac3-4609-8351-40ca1cad5ab2 req-1b27500b-0084-454c-86d6-b1781324ff7d service nova] Creating event network-vif-plugged:034c673a-cd22-42e5-bff2-855d7907c09a for instance f582d9e6-0bc1-47e8-9500-9c7501f659ac on hv-cinder-73362 May 11 06:00:18.444679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-863a7731-eac3-4609-8351-40ca1cad5ab2 req-1b27500b-0084-454c-86d6-b1781324ff7d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093590 May 11 06:00:18.445635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 180/345] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:18.454558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:18.457432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:18.471080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:18.471538 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:18.472322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:18.472762 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:18.681907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:18.703210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7eea8430-a887-41d5-9932-585da88aea3c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.256146 May 11 06:00:18.708700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 181/346] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:18 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:18.733825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:18.734632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:18.753268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:18.753826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:18.754675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:18.755185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.016087 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.025875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.045174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-983258b3-78b1-4c1e-a7b1-937074127d03 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.334989 May 11 06:00:19.047353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 182/347] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:18 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:19.052200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:19.052699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1a526292-cb9e-4608-b2c2-46707ca5c163 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 1.122784 May 11 06:00:19.069905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 166/348] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:17 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:19.094043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:19.110557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.111012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.111795 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.112228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.238487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-d4a052c0-7063-4abb-ae7c-4dbe15c6264e req-f80e88e0-b527-4f9e-9e80-58322a565b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:19.255201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d4a052c0-7063-4abb-ae7c-4dbe15c6264e req-f80e88e0-b527-4f9e-9e80-58322a565b39 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.255705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d4a052c0-7063-4abb-ae7c-4dbe15c6264e req-f80e88e0-b527-4f9e-9e80-58322a565b39 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.280267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-d4a052c0-7063-4abb-ae7c-4dbe15c6264e req-f80e88e0-b527-4f9e-9e80-58322a565b39 service nova] Creating event network-changed:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:00:19.286664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-d4a052c0-7063-4abb-ae7c-4dbe15c6264e req-f80e88e0-b527-4f9e-9e80-58322a565b39 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051769 May 11 06:00:19.287944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 167/349] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:19.325018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.333102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3ed8c67b-81e7-414d-ba9c-e20ccee1fe01 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.284475 May 11 06:00:19.334344 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 183/350] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:19 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:19.367586 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:19.368451 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:19.380351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.380807 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.381672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.382152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.542234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.555046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.558672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.560156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-816246b4-cf46-4b2c-a223-bf3bde2b067c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.196993 May 11 06:00:19.565157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 168/351] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:19 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:19.729949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:19.731190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:19.740511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.741750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.742772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:19.743266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:19.899990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:19.914061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7ad593a6-3734-41a5-974c-2752a1c95093 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.187825 May 11 06:00:19.914751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 184/352] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:19 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:20.062677 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:20.065318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:20.072787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.073424 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.074789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.075390 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.076017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:20.076887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:20.088461 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.091443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.095321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.095950 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.276210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.285427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-209dfb75-ab05-4605-80b5-4fe1c20bbf06 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.226925 May 11 06:00:20.289306 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 169/353] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:20 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:20.337000 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.349272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1ba3892a-71a0-45c1-a679-d2f5f2f55d5f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.280367 May 11 06:00:20.349902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 185/354] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:20 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:20.351473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:20.352095 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:20.366424 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.367447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.368504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.369108 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.578774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:20.579740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:20.588449 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.589027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.590213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.591113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.598283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.613342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-63be1fa3-34fa-471a-83d3-b04e7580ddb6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.265848 May 11 06:00:20.613969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 170/355] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:20 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:20.756217 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.764928 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.766729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:20.767942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-be02857d-e71b-4370-b6a9-2094c9b8b900 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.193727 May 11 06:00:20.768605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 186/356] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:20 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:20.932192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:20.932810 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:20.939495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.939944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:20.940981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:20.941441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.091251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:21.099191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-dd809bba-4dcb-42bc-ba11-8c5f5497f245 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.170954 May 11 06:00:21.100794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 171/357] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:20 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:21.311695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:21.313047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:21.319512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.319970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.320761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.321199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.379823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:21.379823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:21.379823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.379823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.380303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.380546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.484246 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:21.499238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a28e21e9-9187-484d-9313-c02f80bf013c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1367 microversion: 2.1 time: 0.191880 May 11 06:00:21.500094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 187/358] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:21 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:21.547205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:21.556263 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3da1e2b6-5cc6-4bc7-879b-d824c7fbb9a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.192347 May 11 06:00:21.556889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 172/359] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:21 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:21.630639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:21.631268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:21.640166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.640633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.641758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.642202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.790903 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:21.791832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:21.802977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.805834 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.806847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:21.809017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:21.898130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:21.907393 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f157ef5c-c056-41f6-b1fd-7ea7f707798a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.280396 May 11 06:00:21.909142 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 188/360] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:21 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:22.025692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.037882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.041453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.043057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8c2afa1a-8399-43ca-9378-de5b1d4bff6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.259518 May 11 06:00:22.044097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 173/361] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:21 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:22.117361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:22.118009 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:22.124639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.125096 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.125965 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.126341 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.299874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.308072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b6b76761-594c-4769-9925-e1c1455d124b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.194906 May 11 06:00:22.310089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 189/362] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:22 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:22.516665 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:22.517284 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:22.528264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.529755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.532144 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.533574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.573080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:22.574347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:22.587941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.588867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.590035 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.595441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.815040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.823463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7761e95e-9430-4a2f-83d5-dd415b1e65bf tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1557 microversion: 2.1 time: 0.310913 May 11 06:00:22.825926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:22.839446 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 174/363] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:22 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1557 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:22.844964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a2422789-db11-4bed-8fd3-33f3e4a1136b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.275761 May 11 06:00:22.845577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 190/364] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:22 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:22.857296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:22.857830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:22.871587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.871950 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.877003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.877461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.925015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:22.925874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:22.936953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.944864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:22.946104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:22.946771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.127046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6734aae9-864d-4f62-8fb6-cc6f2c127c73 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.286235 May 11 06:00:23.127695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 175/365] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:00:22 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:23.132548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:23.136084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:23.148455 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.164582 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:23.168514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.171744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.173079 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.183635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-26a9b11a-3bee-4273-ba1f-10487ce18d16 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.262216 May 11 06:00:23.189630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 191/366] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:22 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:23.326207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:23.327679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:23.341922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.343388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.344305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.346749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.557984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:23.566840 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ed1a1f4b-a11a-4f93-9810-140570edd230 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.245066 May 11 06:00:23.568151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 192/367] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:23 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:23.597522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:23.611731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:23.613807 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:23.615889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cb58f8c5-7290-45c2-9ade-18f0218275af tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.487040 May 11 06:00:23.630959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 176/368] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:23 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:23.865168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:23.866627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:23.884361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.885772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:23.888019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:23.889303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.165718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.176313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4975471f-31a0-4152-afff-991e030cb0e1 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.317976 May 11 06:00:24.189932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 193/369] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:23 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:24.203740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:24.204371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:24.211530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.211974 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.218393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.219024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.457885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.466269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a684ac48-d0e7-4279-9875-55455558ee8f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.266438 May 11 06:00:24.475340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 177/370] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:24 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:24.585562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:24.586177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:24.598490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.598954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.599783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.600432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.636499 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:24.638172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:24.649699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.650479 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.652824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:24.655275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:24.860459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.893667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-65bf4d63-bfea-4ac1-a755-a860fde65385 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.312756 May 11 06:00:24.897075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 194/371] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:24 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:24.963621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.982118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.986540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:24.990462 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b1355298-6c01-41a8-acb5-2b12d8a5a2df tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.355695 May 11 06:00:24.991684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 178/372] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:24 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:25.106603 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-2cee2c35-8ea6-4eee-9dc7-8d8cf5f4852e req-67da507e-d525-4bea-8b9d-2ce656a7268e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f582d9e6-0bc1-47e8-9500-9c7501f659ac", "tag": "034c673a-cd22-42e5-bff2-855d7907c09a"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:25.137525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2cee2c35-8ea6-4eee-9dc7-8d8cf5f4852e req-67da507e-d525-4bea-8b9d-2ce656a7268e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.142288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2cee2c35-8ea6-4eee-9dc7-8d8cf5f4852e req-67da507e-d525-4bea-8b9d-2ce656a7268e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.166796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-2cee2c35-8ea6-4eee-9dc7-8d8cf5f4852e req-67da507e-d525-4bea-8b9d-2ce656a7268e service nova] Creating event network-changed:034c673a-cd22-42e5-bff2-855d7907c09a for instance f582d9e6-0bc1-47e8-9500-9c7501f659ac on hv-cinder-73362 May 11 06:00:25.188518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-2cee2c35-8ea6-4eee-9dc7-8d8cf5f4852e req-67da507e-d525-4bea-8b9d-2ce656a7268e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072651 May 11 06:00:25.190295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 195/373] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:25.197161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:25.198056 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:25.206968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.207746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.208758 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.209689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.492933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:25.494619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:25.507038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.507495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.508281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.508719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.520757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:25.531439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0a46e614-c908-4ab9-9761-7db1679d13dd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.339247 May 11 06:00:25.543096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 179/374] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:25 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:25.762432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:25.775542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2f74a67d-aff3-4612-9937-6f95f33b7669 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.287477 May 11 06:00:25.776493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 196/375] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:25 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:25.922824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:25.924633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:25.934467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.935192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:25.936193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:25.936662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.008732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:26.010578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:26.031227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.032300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.033914 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.034906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.348008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:26.359281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:26.361543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:26.363227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5ed0da2f-06f3-41d4-a695-a5f7756d8927 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.358480 May 11 06:00:26.368873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 197/376] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:26 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:26.550905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:26.551599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:26.563652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.567212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.568776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.573438 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.638893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:26.651230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-500e42b7-26c1-4416-8116-abce00586a05 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.733679 May 11 06:00:26.653652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 180/377] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:25 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:26.792003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:26.793459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:26.801737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.802575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.803755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.804567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:26.823930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:26.837213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5c021d54-06aa-4efd-a1bc-c6eb13047cc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.290715 May 11 06:00:26.841187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 198/378] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:26 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:26.979255 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-dbbe77eb-e097-49bc-b34e-946f3af620cf req-aab69d38-2021-44c2-aef4-9aec808f6b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56072492-2dc2-4297-81ad-5f56dd97e54a", "name": "network-vif-plugged", "status": "completed", "tag": "7bedeb63-cb08-4227-a110-028c3175d7d0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:26.992415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-dbbe77eb-e097-49bc-b34e-946f3af620cf req-aab69d38-2021-44c2-aef4-9aec808f6b6f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:26.993287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-dbbe77eb-e097-49bc-b34e-946f3af620cf req-aab69d38-2021-44c2-aef4-9aec808f6b6f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.008000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:27.013320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-dbbe77eb-e097-49bc-b34e-946f3af620cf req-aab69d38-2021-44c2-aef4-9aec808f6b6f service nova] Creating event network-vif-plugged:7bedeb63-cb08-4227-a110-028c3175d7d0 for instance 56072492-2dc2-4297-81ad-5f56dd97e54a on hv-cinder-73362 May 11 06:00:27.017934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-47d6a13b-6890-43da-b9ce-eb892662ccb2 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.229347 May 11 06:00:27.018645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 181/379] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:26 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:27.021246 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-dbbe77eb-e097-49bc-b34e-946f3af620cf req-aab69d38-2021-44c2-aef4-9aec808f6b6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045563 May 11 06:00:27.023115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 199/380] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:27.389454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:27.390091 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:27.397625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.401274 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.403445 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.404204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.537971 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:27.549419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:27.549419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:27.550009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5fa22d65-aa8d-4455-a2d6-0e504b51dd7a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1740 microversion: 2.20 time: 0.165030 May 11 06:00:27.551065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 182/381] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:27 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:27.671356 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:27.672101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:27.678796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.679244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.680063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.680495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.809858 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:27.817083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-28eb44c6-1cb4-422d-89f3-4fba1b84dc8d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.150970 May 11 06:00:27.817671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 200/382] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:27 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:27.858241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:27.858765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:27.864840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.865381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.866254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:27.866807 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:27.997932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:28.006062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-08e7b382-8817-4de5-8cdc-19ccdd3d98d7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.151701 May 11 06:00:28.006610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 183/383] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:27 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:28.034702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:28.035318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:28.041113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.041601 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:28.042376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.043308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:28.175373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:28.183429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dcb9814d-15ed-476b-ab23-e8ff63735ea5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.152284 May 11 06:00:28.184010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 201/384] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:28 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:28.569542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:28.570148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:28.576019 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.576666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:28.577434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.579038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:28.712413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:28.720512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:28.722058 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:28.723246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1268ba47-619d-4e62-a285-11443a8311f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.157621 May 11 06:00:28.723799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 184/385] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:28 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:28.835490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:28.836294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:28.842957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.843397 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:28.844479 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:28.844992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.024297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:29.025016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:29.032590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.033405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.034368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.034901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.218548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.226814 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ff03568f-0a69-46b2-b786-cbfe237d8cd0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.206522 May 11 06:00:29.235522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.237492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 185/386] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:29 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:29.242728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:29.243351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:29.243777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7e7d77b3-01a3-42a1-8d1a-8ba30f317211 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.413152 May 11 06:00:29.244358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 202/387] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:28 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:29.250118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.250573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.251353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.251792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.384267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.393375 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ac242fe7-e283-4c70-ab0c-1847ca287bb1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.154558 May 11 06:00:29.393995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 186/388] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:29 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:29.741544 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:29.742160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:29.749010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.749489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.750256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:29.751192 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:29.879821 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.888529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.890269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:29.891885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dfe38fb2-730c-4295-a6ee-d3ea44389cc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.154468 May 11 06:00:29.892509 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 203/389] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:29 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:30.249140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:30.249820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:30.256133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.256581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.257636 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.258076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.262831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:30.263539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:30.269775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.270290 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.271118 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.271610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.392888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:30.400415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:30.400750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-747b24b4-6968-48ae-9f5b-d12a195d5d9e tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.155922 May 11 06:00:30.401318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 187/390] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:30 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:30.408285 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-44f26eec-8566-4957-bd79-052c46eaed5c tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.149959 May 11 06:00:30.408988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 204/391] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:30 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:30.410513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:30.411186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:30.416985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.417531 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.418370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.418801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.547787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:30.555035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-536d3f71-1829-4424-8aa4-2cc55a960bc9 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1266 microversion: 2.1 time: 0.148391 May 11 06:00:30.555604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 188/392] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:30 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:30.906323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-9aa69dcf-50cc-4921-b20b-719745175e79 req-204ccb95-24b6-40f4-bfde-6c1490b72299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "name": "network-vif-unplugged", "status": "completed", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:30.909823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:30.910647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:30.914648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-9aa69dcf-50cc-4921-b20b-719745175e79 req-204ccb95-24b6-40f4-bfde-6c1490b72299 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.915362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-9aa69dcf-50cc-4921-b20b-719745175e79 req-204ccb95-24b6-40f4-bfde-6c1490b72299 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.916969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.917587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.918448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:30.918941 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:30.933834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-9aa69dcf-50cc-4921-b20b-719745175e79 req-204ccb95-24b6-40f4-bfde-6c1490b72299 service nova] Creating event network-vif-unplugged:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 06:00:30.942302 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-9aa69dcf-50cc-4921-b20b-719745175e79 req-204ccb95-24b6-40f4-bfde-6c1490b72299 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040826 May 11 06:00:30.943009 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 205/393] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:31.114483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.124618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.127326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.128502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-eb1c5b12-ccec-4512-9ba8-4f083f86a3d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.222670 May 11 06:00:31.129088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 189/394] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:30 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:31.258491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-26357602", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:31.309758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] validate_networks() for None {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:00:31.418232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:31.418773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:31.424838 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.425493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.426136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.426567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.563619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.572862 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-690d83b5-3c06-4083-b50f-9fa16e857314 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.158632 May 11 06:00:31.573699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 190/395] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:31 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:31.581996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:31.582688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:31.588850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.589619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.590465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.591261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.593500 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:00:31.593922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:00:31.594536 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:00:31.595004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:00:31.595457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:00:31.608521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.609226 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.610968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.611800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.637861 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Getting quotas for project 982a5299d6f241bc931c9ef14945bcd9. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:00:31.643597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Getting quotas for user d9c5c2eea36846eb831c091bb2c90b17 and project 982a5299d6f241bc931c9ef14945bcd9. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:00:31.660191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:00:31.662624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:00:31.708716 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f8ec14b4-1797-4c4d-ad17-acc385f16368 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454765 May 11 06:00:31.709766 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 206/396] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:00:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:00:31.714836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:31.715923 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:31.723069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.723521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.724297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.724901 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.737808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.745249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6adda6b4-47d3-4c69-b753-6f567226382b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.170179 May 11 06:00:31.746468 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 191/397] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:31 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:31.757326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fd0f95e4-02f8-459f-9733-7cf702cf0f31 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:31.757978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fd0f95e4-02f8-459f-9733-7cf702cf0f31 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:31.812872 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fd0f95e4-02f8-459f-9733-7cf702cf0f31 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.819971 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fd0f95e4-02f8-459f-9733-7cf702cf0f31 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1213 microversion: 2.1 time: 0.071676 May 11 06:00:31.820742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 192/398] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:31 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:31.868198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:31.876831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fe592863-961b-482a-b6ec-7c2306e36c0b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1453 microversion: 2.1 time: 0.165712 May 11 06:00:31.877587 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 207/399] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:31 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:31.896086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:31.896778 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:31.903587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.904039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:31.904806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:31.905242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.068001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.080845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a1a03513-7618-4b04-914a-44a44bc9a953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1453 microversion: 2.1 time: 0.188369 May 11 06:00:32.081448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 193/400] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:31 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:32.151944 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:32.152967 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:32.162629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.163320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.164760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.165382 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.345952 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.354558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.356909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.358144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8e28b16a-5d99-4db7-be8b-98356f8aa0fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.213323 May 11 06:00:32.369577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 208/401] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:32 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:32.600591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:32.601794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:32.609993 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.610898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.611889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.612866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.763652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:32.764263 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:32.771071 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.771519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.772289 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.772907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.865085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.874118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c7dc2db1-2b77-4e2d-abbc-86b8c60706b9 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.277478 May 11 06:00:32.876041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 194/402] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:32 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:32.880864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:32.881724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:32.888624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.889968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.890748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:32.891435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:32.925984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.934854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e9ba7dbf-dd86-4b0d-ab48-23e79003f608 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.175691 May 11 06:00:32.935451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 209/403] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:32 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:32.972521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:32.979784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-af1329da-b533-4a7b-8bff-cbc59185e43c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1265 microversion: 2.1 time: 0.102508 May 11 06:00:32.980540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 195/404] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:32 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:33.380792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:33.381349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:33.388599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.389050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.389866 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.390309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.554172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:33.563320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:33.564910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:33.566191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-01944930-3785-42ad-82aa-8a5f155278d0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.189420 May 11 06:00:33.567095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 210/405] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:33 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:33.719176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1b8c2eaf-fdf0-4c34-9512-cb4032a982bf req-fa3104e7-1fe7-4ea3-9348-7223e1c73e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "name": "network-vif-plugged", "status": "completed", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:33.727344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1b8c2eaf-fdf0-4c34-9512-cb4032a982bf req-fa3104e7-1fe7-4ea3-9348-7223e1c73e92 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.727792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1b8c2eaf-fdf0-4c34-9512-cb4032a982bf req-fa3104e7-1fe7-4ea3-9348-7223e1c73e92 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.742219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1b8c2eaf-fdf0-4c34-9512-cb4032a982bf req-fa3104e7-1fe7-4ea3-9348-7223e1c73e92 service nova] Creating event network-vif-plugged:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:00:33.747350 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1b8c2eaf-fdf0-4c34-9512-cb4032a982bf req-fa3104e7-1fe7-4ea3-9348-7223e1c73e92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032893 May 11 06:00:33.748176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 196/406] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:33.897204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:33.897885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:33.904187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.904578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.905601 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.906118 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.953287 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:33.954162 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:33.960471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.961198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:33.962015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:33.962455 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.056249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.065169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-24e96384-95c5-4fb8-a22e-ff27789c0b64 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.172453 May 11 06:00:34.065788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 211/407] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:33 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:34.080618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:34.081237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:34.087177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.087636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.088419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.088863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.166016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.175057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fa1b1be2-92cf-4e7b-ace3-e5da42d99e66 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1273 microversion: 2.1 time: 0.098144 May 11 06:00:34.176016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 212/408] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:34 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:34.196517 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.205986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3e98ec4e-33bc-42e0-9ad3-1569d915bd4e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.257878 May 11 06:00:34.206678 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 197/409] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:33 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:34.398499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-0d8f6227-933c-4c7b-bdae-b6023d7e244d req-60f9c5cc-bb6f-4bdd-91f6-e03d21bc6eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56072492-2dc2-4297-81ad-5f56dd97e54a", "tag": "7bedeb63-cb08-4227-a110-028c3175d7d0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:34.410156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0d8f6227-933c-4c7b-bdae-b6023d7e244d req-60f9c5cc-bb6f-4bdd-91f6-e03d21bc6eb5 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.410632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0d8f6227-933c-4c7b-bdae-b6023d7e244d req-60f9c5cc-bb6f-4bdd-91f6-e03d21bc6eb5 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.423563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-0d8f6227-933c-4c7b-bdae-b6023d7e244d req-60f9c5cc-bb6f-4bdd-91f6-e03d21bc6eb5 service nova] Creating event network-changed:7bedeb63-cb08-4227-a110-028c3175d7d0 for instance 56072492-2dc2-4297-81ad-5f56dd97e54a on hv-cinder-73362 May 11 06:00:34.429456 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-0d8f6227-933c-4c7b-bdae-b6023d7e244d req-60f9c5cc-bb6f-4bdd-91f6-e03d21bc6eb5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036752 May 11 06:00:34.430830 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 213/410] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:34.585211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:34.586228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:34.592927 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.593376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.594188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.594622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.748027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.764513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.765041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee85fb1f-c167-4894-b0ae-d08fe66b3b0a", "device": "/dev/sdb"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:34.766675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:34.767115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:34.767846 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-47dd823d-0b30-4a71-95be-152c939c25cb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.186670 May 11 06:00:34.768391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 198/411] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:34 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:34.783812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.784270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:34.785034 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:34.785495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.082774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:35.083616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:35.090408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.090859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.091637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.092076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.227342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.239821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e81406b6-f7f2-4a3b-b11b-5c4c9779798b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.160824 May 11 06:00:35.240519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 199/412] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:35 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:35.245627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:35.246189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:35.253082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.253671 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.254457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.254914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.320739 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.329942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4179e6c9-d605-45d3-b136-3d07c2171d5d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1273 microversion: 2.1 time: 0.088283 May 11 06:00:35.330535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 200/413] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:35 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:35.335148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:35.335763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:35.342913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.343362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.344145 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.344582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.487019 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.498613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-11215bae-1021-44db-9377-09f3cc71eb0a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.167034 May 11 06:00:35.499203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 201/414] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:35 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:35.786069 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:35.786666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:35.793763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.794211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.794982 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:35.795418 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:35.925043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.934035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.935552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:35.936716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4205eafb-61ff-4200-94ae-b30a66195f39 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1722 microversion: 2.20 time: 0.154674 May 11 06:00:35.937309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 202/415] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:35 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:36.257756 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:36.258367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:36.265010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.265458 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.266504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.266973 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.447418 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:36.456980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5342a30d-9aad-4358-8889-cf5108a2fce8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1724 microversion: 2.1 time: 0.202987 May 11 06:00:36.457921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 203/416] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:36 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:36.462936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:36.463690 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:36.472784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.473266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.474548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.475210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.622491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:36.633190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a79ed887-6d01-4316-b0eb-abfbc24ce7b5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1271 microversion: 2.1 time: 0.173600 May 11 06:00:36.634188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 204/417] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:36 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:36.638463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:36.639062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:36.649372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.650633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.652662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.653377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.930107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dfe9342c-647b-4fcf-ad98-f0ac319b5ebe tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "POST /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.169272 May 11 06:00:36.935887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 214/418] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:00:34 2022] POST /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152/os-volume_attachments => generated 194 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:36.957042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:36.958344 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:36.967620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.968248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:36.969102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:36.969813 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.122436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.130891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.132523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.133930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-68e83d38-08c0-4e82-9967-4670e2613664 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1725 microversion: 2.20 time: 0.182058 May 11 06:00:37.134642 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 215/419] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:36 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:37.153197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04dbecaf-535a-4a5e-af97-f95fb4a38047"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:37.154589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.157917 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.160474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.160922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.161790 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.162221 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.169510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e6c772f2-23f2-4555-b526-dc26da232758 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.534110 May 11 06:00:37.180835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 205/420] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:36 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:37.475301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:37.477505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.486064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.486394 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.487429 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.488025 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.535278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bb383620-f6e3-40c3-a5c8-69173d714404 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.386262 May 11 06:00:37.536158 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 216/421] 10.222.0.44 () {62 vars in 1363 bytes} [Wed May 11 06:00:37 2022] POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 06:00:37.653050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:37.653922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.668943 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.673361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.674708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.675374 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.750299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.757742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b30d9cfd-d71c-4d2b-83a5-18d18cb4ed82 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1271 microversion: 2.1 time: 0.109946 May 11 06:00:37.758321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 217/422] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:37 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:37.763376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:37.763999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.770088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.770540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.771323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.771790 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.825354 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:37.834065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5ca7e237-ce5e-4c7f-99a4-1f38a6c80e86 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1701 microversion: 2.1 time: 0.362936 May 11 06:00:37.834771 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 206/423] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:37 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1701 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:37.851333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-10cf29f9-b67c-4f78-afa1-c583977a2bdd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:37.858207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-10cf29f9-b67c-4f78-afa1-c583977a2bdd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.858641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-10cf29f9-b67c-4f78-afa1-c583977a2bdd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.873727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-83b0584a-967b-496c-9d18-5c9d9f51ccc4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/action" status: 202 len: 0 microversion: 2.20 time: 0.114024 May 11 06:00:37.877560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 218/424] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 06:00:37 2022] POST /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:00:37.884445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:37.885269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.891217 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-10cf29f9-b67c-4f78-afa1-c583977a2bdd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Going to try to start instance {{(pid=117335) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 06:00:37.894446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.895017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.896016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.897036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.945870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-10cf29f9-b67c-4f78-afa1-c583977a2bdd tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action" status: 202 len: 0 microversion: 2.1 time: 0.098338 May 11 06:00:37.946847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 207/425] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:00:37 2022] POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:00:37.959228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:37.960110 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:37.967413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.967996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:37.969188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:37.969748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:38.096474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:38.109051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:38.110742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:38.111932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0bfd38d8-414b-41e5-9b83-c0f1f2d0d4c5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1751 microversion: 2.20 time: 0.232867 May 11 06:00:38.112850 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 219/426] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:37 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1751 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:38.192884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:38.193869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:38.203041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:38.203252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:38.203976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:38.204419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:38.245737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:38.262855 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca3075a8-e1b6-4c4e-bce6-51894e4dda32 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1710 microversion: 2.1 time: 0.311397 May 11 06:00:38.263473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 208/427] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:37 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1710 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:38.392028 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:38.399990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0c2e54ad-15c6-4e54-865c-88f28a2bca67 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1370 microversion: 2.1 time: 0.212156 May 11 06:00:38.401083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 220/428] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:38 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:38.779135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:38.780016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:38.790912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:38.791576 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:38.792532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:38.793295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.130954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:39.132188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:39.140155 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.149512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.150115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.151076 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.152343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.155518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f72b4af4-166b-4480-bb83-2521582f151c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.380913 May 11 06:00:39.156573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 209/429] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:38 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:39.281521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:39.282955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:39.290732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.291465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.293206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.293863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.295253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.306692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.308223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.309413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-26a7ffed-a51b-493f-a351-3be0d4a8aaeb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1751 microversion: 2.20 time: 0.182470 May 11 06:00:39.310385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 221/430] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:39 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:39.418996 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:39.419822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:39.426677 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.427755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.429114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.429600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.524504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.543997 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-041baef7-e164-4697-81f4-d09b9009762c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1710 microversion: 2.1 time: 0.267176 May 11 06:00:39.545127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 210/431] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:39 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1710 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:39.583890 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:39.592427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2c8e04b6-41b5-4978-a8d0-5751b3326caa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1563 microversion: 2.1 time: 0.178042 May 11 06:00:39.598939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 222/432] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:39 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1563 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:39.610933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:39.611684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:39.620121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.621044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.622084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.622703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.752820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9684f5a8-74e9-4616-93e9-05b3eba977a2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147061 May 11 06:00:39.753411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 211/433] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:00:39 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:39.935092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-3835aa3b-ba4f-44a4-a407-f5f459ef4009 req-08857f9f-dd9a-4413-a64d-0f597cbad6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7581f9-964e-4cf2-ad37-aa33d588844e", "tag": "37a27719-a163-4764-af52-5b8d3fafb7f0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:39.951648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-3835aa3b-ba4f-44a4-a407-f5f459ef4009 req-08857f9f-dd9a-4413-a64d-0f597cbad6ff service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:39.952078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-3835aa3b-ba4f-44a4-a407-f5f459ef4009 req-08857f9f-dd9a-4413-a64d-0f597cbad6ff service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:39.965616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-3835aa3b-ba4f-44a4-a407-f5f459ef4009 req-08857f9f-dd9a-4413-a64d-0f597cbad6ff service nova] Creating event network-changed:37a27719-a163-4764-af52-5b8d3fafb7f0 for instance cc7581f9-964e-4cf2-ad37-aa33d588844e on hv-cinder-73362 May 11 06:00:39.971042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-3835aa3b-ba4f-44a4-a407-f5f459ef4009 req-08857f9f-dd9a-4413-a64d-0f597cbad6ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047483 May 11 06:00:39.971712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 223/434] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:40.173111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:40.174048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:40.185947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.186643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.187838 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.188285 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.328734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:40.329703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:40.336458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.337005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.338260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.339208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.408826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:40.417391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f9dd470f-1049-4aca-aa09-dc477d8a7f81 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.248520 May 11 06:00:40.418335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 212/435] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:40 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:40.561822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:40.562637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:40.568676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.569431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.570411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:40.570813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:40.630079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:40.639227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:40.641223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:40.642467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-171ebcf7-2212-48f1-b23b-4c8e9e61e633 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.318168 May 11 06:00:40.643029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 224/436] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:40 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:40.806609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:40.816313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-01f324c3-bf98-4b1a-80d5-3e076a0800f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1710 microversion: 2.1 time: 0.257965 May 11 06:00:40.817191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 213/437] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:40 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1710 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:41.436074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:41.436964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:41.444750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.445617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.446005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.446481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.466677 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1147b437-d239-4f4f-8ea2-3818ebc15d0e req-026002d6-bb27-4e4b-a531-771db417b708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:41.475016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1147b437-d239-4f4f-8ea2-3818ebc15d0e req-026002d6-bb27-4e4b-a531-771db417b708 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.475463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1147b437-d239-4f4f-8ea2-3818ebc15d0e req-026002d6-bb27-4e4b-a531-771db417b708 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.488060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1147b437-d239-4f4f-8ea2-3818ebc15d0e req-026002d6-bb27-4e4b-a531-771db417b708 service nova] Creating event network-changed:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:00:41.494172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1147b437-d239-4f4f-8ea2-3818ebc15d0e req-026002d6-bb27-4e4b-a531-771db417b708 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031121 May 11 06:00:41.495079 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 214/438] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:00:41.598681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:41.607460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-19539478-0a46-43ab-8cbd-42ccb68fbdd8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.176756 May 11 06:00:41.608053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 225/439] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:41 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:41.661972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:41.662624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:41.669777 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.670228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.671005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.671442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.808470 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:41.817459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:41.818994 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:41.820156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e106a3cc-d98d-452c-a4ce-cb9976eb5589 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.162606 May 11 06:00:41.820722 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 215/440] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:41 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:41.835984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:41.836596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:41.842458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.842911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.843677 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:41.844117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:41.976380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:41.984472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6f5cc7d9-815b-4d55-867d-3aef5eb1e77c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1710 microversion: 2.1 time: 0.152768 May 11 06:00:41.985059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 226/441] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:41 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:42.624842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:42.625459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:42.631868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:42.632310 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:42.633068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:42.633522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:42.763249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:42.771084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2e347d01-bf11-41e4-a253-fb57b597ee46 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.150102 May 11 06:00:42.771645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 216/442] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:42 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:42.840886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:42.841550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:42.848818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:42.849399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:42.850345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:42.850875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:42.997789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:43.002118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:43.002871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:43.006309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:43.007816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:43.008710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:43.008977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d07558db-212c-49b1-805e-7106005cb833 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.173452 May 11 06:00:43.009154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:43.009565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 227/443] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:42 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:43.010023 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:43.010547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:43.196639 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:43.204956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-de5069a5-a4ef-452c-ba68-76830b1d9b6a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1710 microversion: 2.1 time: 0.206543 May 11 06:00:43.205659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 217/444] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:42 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1710 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:43.788230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:43.788852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:43.794871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:43.795325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:43.796100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:43.796535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:43.929263 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:43.937026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8694cdcd-65cb-41d0-a552-dd44eeae4cfe tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.152715 May 11 06:00:43.937636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 228/445] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:43 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:44.027630 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:44.028310 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:44.034708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.035164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:44.035933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.036371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:44.164601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:44.173035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:44.175576 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:44.178498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fb3314b7-d41e-43f8-9b92-37231e0b6696 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.154119 May 11 06:00:44.179847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 218/446] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:44 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:44.223084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:44.223700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:44.230406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.230859 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:44.231636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.232074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:44.368549 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:44.378430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-602a619d-d682-4180-97d1-bb317bd4d71d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1714 microversion: 2.1 time: 0.159212 May 11 06:00:44.379026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 229/447] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:44 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:44.954164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:44.954835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:44.961077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.961603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:44.962379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:44.962853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.041413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:45.042881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:45.049583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.050045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.050892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.051336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.099530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:45.108301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d15c851f-eb28-4cbf-9500-54e318749055 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.157865 May 11 06:00:45.108972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 219/448] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:44 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:45.126486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5588ecce-2b09-44cb-b047-ed093e9ea3ac tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action" status: 202 len: 0 microversion: 2.1 time: 0.088763 May 11 06:00:45.127129 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 230/449] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:00:45 2022] POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:00:45.135949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:45.136635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:45.142874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.143326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.144124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.144623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.199628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:45.200331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:45.207112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.207570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.208349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:45.208789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:45.296165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:45.304278 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ceedb463-e9cb-4337-88b3-e3865f624cad tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1752 microversion: 2.1 time: 0.172904 May 11 06:00:45.305080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 220/450] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:45 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:45.344259 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:45.356879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:45.358487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:45.359760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c18db70e-724d-4530-a66e-2a771ad3f30c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.165356 May 11 06:00:45.360364 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 231/451] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:45 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:46.126092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:46.126767 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:46.133671 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.134691 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.136363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.136966 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.171399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-c5528c72-897c-4be0-97bb-55749484ba5a req-eddf290b-ce27-445f-90e7-27e5852026e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7581f9-964e-4cf2-ad37-aa33d588844e", "name": "network-vif-plugged", "status": "completed", "tag": "37a27719-a163-4764-af52-5b8d3fafb7f0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:00:46.194331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-c5528c72-897c-4be0-97bb-55749484ba5a req-eddf290b-ce27-445f-90e7-27e5852026e8 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.195228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-c5528c72-897c-4be0-97bb-55749484ba5a req-eddf290b-ce27-445f-90e7-27e5852026e8 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.209982 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-c5528c72-897c-4be0-97bb-55749484ba5a req-eddf290b-ce27-445f-90e7-27e5852026e8 service nova] Creating event network-vif-plugged:37a27719-a163-4764-af52-5b8d3fafb7f0 for instance cc7581f9-964e-4cf2-ad37-aa33d588844e on hv-cinder-73362 May 11 06:00:46.216435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-c5528c72-897c-4be0-97bb-55749484ba5a req-eddf290b-ce27-445f-90e7-27e5852026e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048805 May 11 06:00:46.217262 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 232/452] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:00:46.288025 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:46.296012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-60cbbd1b-53fd-4161-a1db-d480fbc0d108 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.174468 May 11 06:00:46.296571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 221/453] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:46 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:46.326312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:46.327416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:46.335222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.335667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.336428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.336863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.379402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:46.379629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:46.386225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.388168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.389339 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:46.390667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:46.574695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:46.585233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:46.595832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:46.597652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-180fe1b5-f3de-4e19-8ac6-4005da152a20 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.222708 May 11 06:00:46.598426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 222/454] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:46 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:46.661819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:46.672479 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7e05f54c-4852-4037-9081-3681d3ffcde5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1752 microversion: 2.1 time: 0.354225 May 11 06:00:46.673069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 233/455] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:46 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1752 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:47.317578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:47.318359 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:47.327600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.328479 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.329802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.330356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.458578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:47.465922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d70983bc-2193-4869-8231-851ebf89d5ec tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.152115 May 11 06:00:47.466485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 223/456] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:47 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:47.618377 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:47.618984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:47.625651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.626104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.626867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.627304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.689857 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:47.690456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:47.696202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.696643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.697408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:47.697935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:47.755223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:47.763654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:47.765162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:47.766606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-62ce4d64-5540-47a9-a3dd-e491f20f654f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.152947 May 11 06:00:47.767167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 234/457] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:47 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:47.841915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:47.849776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-59b5ccc1-3039-47d4-bd47-a4084829ebb8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1752 microversion: 2.1 time: 0.163927 May 11 06:00:47.850344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 224/458] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:47 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:48.482575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:48.483189 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:48.489281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.489758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.490524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.490960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.615279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:48.625288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-331f8428-c03e-48b0-bd7d-c17ea2ecbe61 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.146592 May 11 06:00:48.625918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 235/459] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:48 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:48.785279 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:48.785847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:48.793192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.793692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.794459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.794934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.867744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:48.868401 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:48.879986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.880477 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.881266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:48.881722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:48.926054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:48.934434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:48.935928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:48.937073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5a735e1e-730b-42de-a5af-24e8810d59e8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.155832 May 11 06:00:48.937660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 225/460] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:48 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:49.024995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:49.033450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f482e95f-c443-49a7-8473-9f0031d3f493 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1752 microversion: 2.1 time: 0.169698 May 11 06:00:49.034050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 236/461] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:48 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:49.641815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:49.642259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:49.648155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:49.648598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:49.649355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:49.649808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:49.772689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:49.780021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9f09e377-c917-4e16-b3cf-b2dd019e6868 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.142585 May 11 06:00:49.780580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 226/462] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:49 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:49.955251 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:49.955881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:49.962217 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:49.962661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:49.963943 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:49.964475 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:50.050472 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:50.051085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:50.057316 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:50.057802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:50.058565 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:50.058995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:50.089215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:50.097526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:50.099032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:50.100190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dd4a25fa-2aa8-4feb-9829-08bcc20c10ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.148836 May 11 06:00:50.100746 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 237/463] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:49 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:50.205107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:50.213133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-832a3a04-e037-4d7e-8d35-6e88a6047323 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1752 microversion: 2.1 time: 0.166373 May 11 06:00:50.214279 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 227/464] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:50 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:50.796521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:50.797126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:50.803074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:50.803557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:50.804331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:50.804748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:50.941938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:50.950269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-cf1f6f10-47c8-4269-a583-8abc2e3f48de tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.157587 May 11 06:00:50.950836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 238/465] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:50 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:51.121534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:51.122816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:51.133660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.133660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:51.133660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.134327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:51.231497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:51.232150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:51.238667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.239116 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:51.239909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.240385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:51.271465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:51.281428 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:51.282970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:51.284134 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a3a0caa8-7072-4a14-a3ba-ca38df259b4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1753 microversion: 2.20 time: 0.168651 May 11 06:00:51.284699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 228/466] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:51 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:51.388597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:51.396658 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ea59dadf-34b8-48fe-9980-904e93e86324 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.169619 May 11 06:00:51.397228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 239/467] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:51 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:51.968126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:51.968653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:51.974720 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.975256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:51.976165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:51.976601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:52.100451 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:52.107678 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e357844f-af25-4ef2-85df-0415974ceaa9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.144614 May 11 06:00:52.108241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 229/468] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:51 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:52.302080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:52.302691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:52.309755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:52.310212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:52.310972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:52.311410 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:52.423928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:52.426822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:52.435186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:52.435641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:52.436415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:52.436851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:52.440939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:52.449875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:52.451385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:52.452638 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b726608c-fe09-4b68-adf1-ad09539d7710 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.154525 May 11 06:00:52.453202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 240/469] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:52 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:52.579190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:52.586955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2821fe91-a9bb-401a-8e6e-2e53ec97f8b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.169275 May 11 06:00:52.587528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 230/470] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:52 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:53.124126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:53.124739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:53.130590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.131044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.131812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.132250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.264644 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:53.272110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-975bc725-76a2-4117-a2e7-cff7cc0b88bd tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.151966 May 11 06:00:53.272671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 241/471] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:53 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:53.471220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:53.471762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:53.478118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.478569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.479333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.479815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.604003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:53.604694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:53.605457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:53.611167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.611781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.612391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:53.612832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:53.614020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:53.615660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:53.616934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8e69ae48-b90e-413b-8754-6e93e2ff46fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.149693 May 11 06:00:53.617558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 231/472] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:53 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:53.753932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:53.762305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f995a1f9-f9d7-401a-b450-a5758807d521 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.162135 May 11 06:00:53.762869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 242/473] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:53 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:54.289364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:54.290016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:54.296618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.297071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.297868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.298308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.426828 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:54.434219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-94d35f91-cd90-4596-8e08-24852e19e0c4 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1313 microversion: 2.1 time: 0.148774 May 11 06:00:54.434791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 232/474] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:54 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:54.635565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:54.636362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:54.642997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.643448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.644201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.644636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.769656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:54.778757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:54.779990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:54.780459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:54.780603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:54.781970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-131b5506-0c70-467f-9a61-ef87dca652fc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.150373 May 11 06:00:54.782543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 243/475] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:54 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:54.786816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.787258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.788012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:54.788438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:54.969017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:54.976815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-309141dc-7d5e-445a-bfa8-922306ffc2a0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.201305 May 11 06:00:54.977379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 233/476] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:54 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:55.450990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:55.451526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:55.457522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.457981 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.458749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.459188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.594874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:55.602397 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1912850d-db0c-462b-beb6-a0ae25851ee8 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1463 microversion: 2.1 time: 0.155441 May 11 06:00:55.603397 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 244/477] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:55 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:55.641124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:55.641662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:55.647447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.647897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.648657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.649094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.673404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:00:55.744443 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f1af5870-3a2d-45bc-b3b9-f8382345005e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 204 len: 0 microversion: 2.1 time: 0.107152 May 11 06:00:55.745026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 234/478] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:00:55 2022] DELETE /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:00:55.753097 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:55.753747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:55.759961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.760413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.761772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.762211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.800590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:55.801273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:55.807621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.808065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.808830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:55.809260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:55.890305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:55.898064 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8159e7a5-7a8b-45b4-ab6c-766c437917f6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.148857 May 11 06:00:55.898754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 245/479] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:55 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:55.941796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:55.950664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:55.952203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:55.953362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e8a1c48c-114e-4a4f-9b24-edab41c324d3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.156916 May 11 06:00:55.953950 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 235/480] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:55 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:55.994578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:55.995639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:56.001515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.001987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:56.002740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.003244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:56.142845 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:56.150792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a46eb0a5-d804-4d89-b95b-58c2f7c29811 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.160168 May 11 06:00:56.151365 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 246/481] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:55 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:00:56.915281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:56.915905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:56.922712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.923155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:56.923935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.924362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:56.972490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:56.973143 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:56.979423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.980524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:56.981378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:56.981838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:57.050730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:57.058418 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d1ae7d98-5d2a-423f-b97d-c85b9897ef56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.147034 May 11 06:00:57.059073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 236/482] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:56 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:57.111973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:57.120254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:57.122052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:57.123196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ead333f5-4159-4741-9322-bae458937ae7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.155301 May 11 06:00:57.123751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 247/483] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:56 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:00:57.168230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:57.168779 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:57.174750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:57.175202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:57.175968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:57.176402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:57.316401 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:57.324879 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-22ff260f-9dd8-43ba-ae80-920283df8d4d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.160759 May 11 06:00:57.325459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 237/484] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:57 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:58.075574 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:58.076184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:58.082618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.083088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.083844 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.084275 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.141906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:58.142495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:58.148672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.149112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.149893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.150324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.212575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:58.220618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-94a5efdf-ff69-45e2-9d46-dd4d0cf6597d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.148998 May 11 06:00:58.221191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 248/485] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:58 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:58.276247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:58.284960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:58.286501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:58.287652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3515e238-e486-4799-aeeb-eaaa837c5088 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.149956 May 11 06:00:58.288213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 238/486] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:58 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:58.342841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:58.343490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:58.349416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.349893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.350647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:58.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:58.498552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:58.506266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1102f6d3-f490-41ad-8048-b34eb4bead27 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.168147 May 11 06:00:58.506864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 249/487] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:58 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:59.238018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:59.238631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:59.244926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.246327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.247100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.247536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.306394 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:59.307145 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:59.314852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.315312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.316089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.316527 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.378082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:59.385534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ba7d035d-35d4-415b-b54e-24f455675353 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.151385 May 11 06:00:59.386156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 239/488] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:59 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:00:59.448738 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:59.456899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:59.458434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:59.459577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2c7f16f4-23b3-4b9b-ac2f-1023757a559d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.157176 May 11 06:00:59.460128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 250/489] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:00:59 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:00:59.523892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:00:59.524509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:00:59.530453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.530906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.531675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:00:59.532112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:00:59.668851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:00:59.676596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d0ec2466-89b6-4baf-beea-451eabe49dfc tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.156560 May 11 06:00:59.677162 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 240/490] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:00:59 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:00.404287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:00.404866 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:00.411714 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.412236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.413140 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.413621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.478177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:00.478899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:00.486118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.486581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.487332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.487769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.549568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:00.557285 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1dde0d24-4a00-48e4-afc7-0f7354f64af6 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.157954 May 11 06:01:00.558709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 251/491] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:00 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:00.626290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:00.634411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:00.636569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:00.637740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-57927934-9ade-4a36-b44c-30708e552290 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.163599 May 11 06:01:00.638304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 241/492] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:00 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:00.694137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:00.695057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:00.702051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.702511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.703290 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:00.703736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:00.844943 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:00.852756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-88337403-ffef-4894-92ea-907b9b7f9573 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.162513 May 11 06:01:00.853333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 252/493] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:00 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:01.574710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:01.575323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:01.581643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.582090 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:01.582850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.583284 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:01.655777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:01.656417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:01.662778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.663534 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:01.664003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.664442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:01.727661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:01.735753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a7399863-e8bf-4085-af0a-6b9869237785 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1469 microversion: 2.1 time: 0.165331 May 11 06:01:01.736513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 242/494] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:01 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:01.799419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:01.807632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:01.809155 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:01.810324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-25039db0-a2df-4a39-a8b8-648cb932ffdd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.159468 May 11 06:01:01.810888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 253/495] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:01 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:01.871382 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:01.871913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:01.877637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.878082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:01.878833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:01.879269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.022712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:02.030789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-eb52ac82-3acf-435d-930a-39e70337dab8 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.163870 May 11 06:01:02.031405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 243/496] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:01 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:02.754494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:02.755256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:02.761966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:02.762233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.763641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:02.764083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.831334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:02.832713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:02.842859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:02.843307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.844104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:02.844544 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.864492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:02.873269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-189e1475-d449-4fbe-9d9f-6666edb1837c tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1427 microversion: 2.1 time: 0.122931 May 11 06:01:02.882944 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 254/497] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:02 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:02.882944 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-2bdc56ec-5c0c-4404-9a2f-8b697773020c req-cbf8ee8a-760e-4be7-85dc-88e605e23356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7581f9-964e-4cf2-ad37-aa33d588844e", "name": "network-vif-deleted", "tag": "37a27719-a163-4764-af52-5b8d3fafb7f0"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:02.887250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2bdc56ec-5c0c-4404-9a2f-8b697773020c req-cbf8ee8a-760e-4be7-85dc-88e605e23356 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:02.887695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2bdc56ec-5c0c-4404-9a2f-8b697773020c req-cbf8ee8a-760e-4be7-85dc-88e605e23356 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:02.900510 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-2bdc56ec-5c0c-4404-9a2f-8b697773020c req-cbf8ee8a-760e-4be7-85dc-88e605e23356 service nova] Creating event network-vif-deleted:37a27719-a163-4764-af52-5b8d3fafb7f0 for instance cc7581f9-964e-4cf2-ad37-aa33d588844e on hv-cinder-73362 May 11 06:01:02.907021 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-2bdc56ec-5c0c-4404-9a2f-8b697773020c req-cbf8ee8a-760e-4be7-85dc-88e605e23356 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 May 11 06:01:02.907793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 255/498] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:02.991743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:03.001309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:03.003233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:03.004791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cc9af481-4e3f-43c9-9f03-6b44837266f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.178199 May 11 06:01:03.006177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 244/499] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:02 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:03.050010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:03.050714 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:03.061088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.061481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.062269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.062705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.293387 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:03.302147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-525ed805-a5f5-4fc1-959e-75080c00a7d1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.256692 May 11 06:01:03.302735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 256/500] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:03 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:03.891509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:03.892284 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:03.892903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:03.893498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:03.898948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.899449 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.900220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.900646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.905359 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.905989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.906765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.907683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.933089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:03.933570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:03.934015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:03.979835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:03.987890 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-945b2620-76ea-4505-b56d-7a4875b2e09b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.100818 May 11 06:01:03.988609 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 257/501] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:03 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:04.024203 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:04.024822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:04.032160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:04.032556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:04.033337 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:04.033800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:04.041156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lazy-loading 'services' on Instance uuid 62149b5e-614b-41ef-9fda-7bf2b5175152 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:04.166857 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a2e71885-a9a2-4bd0-8113-b215b1aba3ae tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "DELETE /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152/os-volume_attachments/ee85fb1f-c167-4894-b0ae-d08fe66b3b0a" status: 202 len: 0 microversion: 2.1 time: 0.281523 May 11 06:01:04.167742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 245/502] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:01:03 2022] DELETE /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152/os-volume_attachments/ee85fb1f-c167-4894-b0ae-d08fe66b3b0a => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:01:04.181720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:04.192693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:04.194403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:04.195569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-35c72517-f305-4788-8629-c677c043f4b7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.175522 May 11 06:01:04.196125 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 258/503] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:04 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:04.321016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:04.322111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:04.330057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:04.330562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:04.331343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:04.331786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:04.517399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:04.525682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5428c0ad-1fbb-4aaa-a245-0da0f8d92b42 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.208942 May 11 06:01:04.526357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 246/504] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:04 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:05.004217 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:05.004819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:05.011650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.012219 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.013098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.013698 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.048635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.049089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.049570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:05.087707 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:05.095782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-008b8715-1c71-4444-8228-3b314d738239 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.095419 May 11 06:01:05.096359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 259/505] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:04 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:05.215029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:05.215651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:05.222729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.223191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.224090 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.224528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.375015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:05.383669 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:05.385195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:05.387029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a71ba71d-c4a9-4f72-a9d4-904108bd51f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.176606 May 11 06:01:05.387595 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 247/506] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:05 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:05.543270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:05.543917 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:05.549923 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.550370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.551138 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:05.551576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:05.694380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:05.702769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2cea97a1-c4a9-4e5e-88d5-2c8eb64a0805 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.163480 May 11 06:01:05.703350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 260/507] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:05 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:06.113163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:06.113803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:06.119707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.120155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.121546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.121987 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.152947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.153395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.153871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:06.205747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:06.213537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6668c44b-af20-4680-8ff1-1cef20e6d302 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.104090 May 11 06:01:06.214478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 248/508] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:06 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:06.406193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:06.406796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:06.413254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.413731 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.414502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.414929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.567206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:06.576800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:06.578324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:06.579494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0005bb14-c803-40bb-ae41-d3c918c27804 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.177313 May 11 06:01:06.580058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 261/509] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:06 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:06.719714 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:06.720322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:06.726867 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.727322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.728126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:06.728548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:06.875997 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:06.895222 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3c3fab61-3a54-4273-bf27-3445676514e0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.179237 May 11 06:01:06.896164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 249/510] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:06 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:07.230994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:07.231604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:07.237776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.238238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.239015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.239456 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.272684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.273138 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.273612 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:07.315930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:07.326483 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2fd68561-610f-4516-b920-c61fb2374bd9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.099407 May 11 06:01:07.327850 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 262/511] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:07 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:07.597604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:07.598214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:07.604129 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.604572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.605968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.606404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.747057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:07.756617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:07.758281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:07.759645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-02e2c8b9-dd58-4b56-a587-414de48d19a7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.165885 May 11 06:01:07.760622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 250/512] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:07 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:07.913789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:07.915064 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:07.922436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.922890 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:07.923697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:07.924130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.066392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:08.075582 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-47d616d2-58ab-4c12-9d9d-b24956e838d3 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.165572 May 11 06:01:08.076446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 263/513] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:07 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:08.344020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:08.344626 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:08.350650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:08.351093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.351875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:08.352302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.381534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:08.381976 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.382416 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:08.457164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:08.465355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-80b11596-11fa-4e49-8b3c-8ffd08bffb50 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.124978 May 11 06:01:08.474567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 251/514] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:08 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:08.777909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:08.779540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:08.784252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:08.784697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.785502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:08.785939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:08.923939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:08.932887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:08.935002 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:08.936168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c397f83c-1a3b-430f-9746-1fd90677e522 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.162618 May 11 06:01:08.936733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 264/515] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:08 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:09.092338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:09.092920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:09.099090 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.099534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.100289 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.100718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.251629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:09.259460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4c88c24e-0ee1-4f7d-887c-60ed19fa37e6 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.171276 May 11 06:01:09.260037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 252/516] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:09 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:09.483551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:09.484211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:09.494956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.495408 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.496699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.497134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.530103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.530564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.531014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:09.572618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:09.580763 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7e4bea9c-c5f3-40e3-9a2c-5a20110d4fc9 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.101659 May 11 06:01:09.585978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 265/517] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:09 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:09.954236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:09.954845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:09.960866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.961313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:09.962163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:09.962598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.098410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:10.113066 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:10.115205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:10.116985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-90293288-4822-428c-a326-c7c9829b7cab tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.166630 May 11 06:01:10.117572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 253/518] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:09 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:10.276350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:10.277492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:10.283999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:10.284455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.285258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:10.285735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.431800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:10.440925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-da3d4857-2d9d-4d32-88d4-404d1b9373b0 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.168355 May 11 06:01:10.441788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 266/519] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:10 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:10.598942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:10.599567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:10.606908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:10.607362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.608143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:10.608573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.640048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:10.640564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:10.641350 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:10.684716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:10.692154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5b29de7d-b249-4600-95d2-663578cbd39b tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.097925 May 11 06:01:10.692666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 254/520] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:10 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:11.134458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:11.135295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:11.143092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.143539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.144326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.144760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.284206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:11.294058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:11.295619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:11.296829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9cdfce50-a8e6-4851-aae7-b1ed6bf82a49 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.166364 May 11 06:01:11.297903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 267/521] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:11 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:11.458371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:11.458950 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:11.465824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.466273 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.467041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.467481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.638225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:11.658147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a2a9894d-5bc3-40d7-a974-0e922a3489ed tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.203418 May 11 06:01:11.658999 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 255/522] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:11 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:11.712271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:11.712837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:11.719450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.719906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.720699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.721140 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.753145 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:11.753630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:11.754088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:11.800333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:11.807942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ddfd287b-df1a-4dd0-9481-9e7f9e79cf56 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.102553 May 11 06:01:11.808568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 268/523] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:11 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:12.315173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:12.315783 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:12.321732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.322182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.322943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.323376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.462533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:12.473621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:12.475299 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:12.483883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-539a60b3-9442-4f53-8dc9-764d2ad57472 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.165406 May 11 06:01:12.484633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 256/524] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:12 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:12.675508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:12.676127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:12.682466 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.682924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.684226 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.684668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.824283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:12.825045 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:12.829502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:12.830995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.831450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.832230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.832657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.837959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0c2a2f4e-b395-40cb-81c4-2c98ee01f615 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.166212 May 11 06:01:12.838545 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 269/525] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:12 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:12.864346 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:12.864789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:12.865236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:12.915769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:12.923850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d3f4c038-50ed-43c6-8b0d-713383d0817e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.103592 May 11 06:01:12.924412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 257/526] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:12 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:13.504432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:13.505036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:13.510926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.511610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:13.512193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.512622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:13.655508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:13.665522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:13.667183 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:13.668998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6a9c0df8-bec5-4c09-a97c-9abeefebd32e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.169279 May 11 06:01:13.669874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 270/527] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:13 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:13.860519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:13.862075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:13.870072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.870537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:13.871322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.871758 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:13.943821 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:13.944575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:13.951548 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.951999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:13.953029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:13.953761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:14.009789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:14.010241 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:14.010744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:14.037286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:14.045996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-79bfea42-85e5-408b-b88c-34fae9461464 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.194167 May 11 06:01:14.046581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 258/528] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:13 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:14.071425 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:14.080204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-50de6609-63e9-4ae6-8853-a2463253cf40 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.143919 May 11 06:01:14.080931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 271/529] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:13 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:14.689201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:14.689845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:14.696100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:14.696557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:14.697497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:14.697973 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:14.852966 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:14.862025 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:14.863545 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:14.864720 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-25a03cb0-15a9-479a-825f-150ec32349a8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.179448 May 11 06:01:14.865288 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 259/530] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:14 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:15.064649 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:15.065781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:15.073213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.073799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.074805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.075241 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.098845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:15.099463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:15.109972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.110421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.111211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.111642 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.170224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.171283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.172260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:15.217713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:15.229018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3a122c42-b402-4aaf-b4f8-bbc89031234d tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.134130 May 11 06:01:15.230321 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 260/531] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:15 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:15.254402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:15.266464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-feef5714-eb24-4f6a-86f1-90b057794ee5 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.205251 May 11 06:01:15.267799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 272/532] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:15 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:15.885107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:15.890563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:15.892575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.893265 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:15.894594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:15.895231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.035016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:16.044473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:16.046023 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:16.047187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-50e34aa1-6760-414a-9198-8c99765e7105 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.166167 May 11 06:01:16.047753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 261/533] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:15 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:16.252026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:16.252627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:16.258967 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:16.259409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.260166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:16.260596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.285202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:16.285846 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:16.292405 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:16.293370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.293982 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:16.294123 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:16.294569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.295334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:16.295761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:16.338842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:16.346954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-06993c94-4084-4df9-a0cd-b55f543847be tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.098707 May 11 06:01:16.347539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 273/534] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:16 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:16.443252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:16.452046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d36a742a-cae8-41d2-b4cb-c540413c00ae tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1757 microversion: 2.1 time: 0.171753 May 11 06:01:16.452612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 262/535] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:16 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:17.064961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:17.065598 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:17.072684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.073406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.074907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.075353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.215859 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:17.225843 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:17.227336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:17.228513 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a44adaef-fca4-48b9-89d7-f52da1d2c640 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.167507 May 11 06:01:17.229066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 274/536] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:17 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:17.365839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:17.366379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:17.373067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.373532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.374287 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.374715 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.409652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.410063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.410513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:17.456365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:17.464672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ec29a498-c3b7-446b-94e3-b2126f2c60cf tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.102618 May 11 06:01:17.465436 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 263/537] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:17 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:17.471053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:17.471659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:17.478749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.479196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.480058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:17.480458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:17.646556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:17.657412 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8464b2fa-b9f0-41ec-b6c2-2c346d05d696 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1760 microversion: 2.1 time: 0.192105 May 11 06:01:17.658036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 275/538] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:17 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1760 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:18.248695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:18.249308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:18.255528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:18.255978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:18.256741 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:18.257176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:18.332296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:01:18.332542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Wed May 11 06:01:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 (ip 10.222.0.44) !!! May 11 06:01:18.384698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:18.394408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:18.395912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:18.397057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e6bad5ac-dde8-471d-8365-54ec19c42f22 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.152826 May 11 06:01:18.397654 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 264/539] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:18 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:18.482718 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:18.483331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:18.489755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:18.490390 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:18.491015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:18.491452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:18.521989 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:18.522438 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:18.522880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:18.564303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:18.571674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3ac52d81-51d3-4881-b2ec-842f06df7b1e tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.093346 May 11 06:01:18.572244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 276/540] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:18 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:19.416749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:19.417868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:19.433332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:19.434468 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:19.435635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:19.436073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:19.568328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:19.577545 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:19.579057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:19.580250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-051ba35d-fc6c-474b-bfb8-9dc0f0f88718 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.167868 May 11 06:01:19.580809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 265/541] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:19 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:19.587956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:19.588575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:19.595886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:19.596345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:19.597121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:19.597595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:19.629979 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:19.630432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:19.630900 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lazy-loading 'fault' on Instance uuid cc7581f9-964e-4cf2-ad37-aa33d588844e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:19.676244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c5c2eea36846eb831c091bb2c90b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '982a5299d6f241bc931c9ef14945bcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:19.683971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d3ff2ac3-9266-47a2-b48e-992704c615f0 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 200 len: 1303 microversion: 2.1 time: 0.099677 May 11 06:01:19.684794 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 277/542] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:19 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:20.600403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:20.601020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:20.608014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:20.608461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:20.609225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:20.609693 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:20.701054 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:20.701703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] [instance: cc7581f9-964e-4cf2-ad37-aa33d588844e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:20.707895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:20.708348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:20.709127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:20.709590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:20.724626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] HTTP exception thrown: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Request method failure captured: May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e HTTP/1.1 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1D9sZhS7BgqLuc-r7v7BUcuo8FUco2O8_joy6dLMZ-OK2wRnwPv3riTh4IcamrUpFO93Xix-QUeyedov7fIjkfIrpdb_eVGnDR6tyKtnxrK4iLqgGtx_a9hh16D0BkLNb4FBrmXKeAwT7TRXNusFYqKaP45C994laEF4-5M4FQlAIA May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 982a5299d6f241bc931c9ef14945bcd9 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesNegativeTest-1603953189 May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:01:20.726322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/982a5299d6f241bc931c9ef14945bcd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_982a5299d6f241bc931c9ef14945bcd9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/982a5299d6f241bc931c9ef14945bcd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/982a5299d6f241bc931c9ef14945bcd9"}]}] May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesNegativeTest-1603953189 May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 982a5299d6f241bc931c9ef14945bcd9 May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesNegativeTest-1603953189 May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesNegativeTest-1603953189-project May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: d9c5c2eea36846eb831c091bb2c90b17 May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesNegativeTest-1603953189-project May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. May 11 06:01:20.727833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'cc7581f9-964e-4cf2-ad37-aa33d588844e'} May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:01:20.728927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. May 11 06:01:20.730895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:20.731960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] Returning 404 to user: Instance cc7581f9-964e-4cf2-ad37-aa33d588844e could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:01:20.731960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-099ca1c7-458b-455e-8179-667f72bec8d5 tempest-VolumesNegativeTest-1603953189 tempest-VolumesNegativeTest-1603953189-project] 10.222.0.44 "GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e" status: 404 len: 111 microversion: 2.1 time: 0.030467 May 11 06:01:20.731960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 278/543] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:20 2022] GET /compute/v2.1/servers/cc7581f9-964e-4cf2-ad37-aa33d588844e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:01:20.743808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:20.752326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:20.753817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:20.754981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d79fe107-b1e7-4e63-890c-8723ad7ff010 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.158545 May 11 06:01:20.755551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 266/544] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:20 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:21.177315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:21.177913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:21.184973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.185431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.186308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.186691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.211799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:01:21.306420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d05ae716-131a-40d7-a75d-78538ddc84ac tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "DELETE /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 204 len: 0 microversion: 2.1 time: 0.132492 May 11 06:01:21.307040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 279/545] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:01:21 2022] DELETE /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:01:21.315970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:21.316602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:21.322755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.323244 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.324133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.324620 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.456728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:21.464748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-50a8408b-3d5c-462f-bfbd-8b91aecb4c28 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1514 microversion: 2.1 time: 0.152087 May 11 06:01:21.465602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 267/546] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:21 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:21.773792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:21.774493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:21.780969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.781422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.782342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:21.782785 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:21.920174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:21.928678 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:21.930231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:21.931432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9c31cf6d-00b0-48b1-ab1a-feec3d05247c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.161897 May 11 06:01:21.931990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 280/547] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:21 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:22.483015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:22.483635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:22.490111 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:22.490496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:22.491266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:22.491729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:22.627249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:22.635004 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d8dd8f60-0e8a-4b2d-bcb7-0c1ba46badd9 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1514 microversion: 2.1 time: 0.156544 May 11 06:01:22.635657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 268/548] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:22 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:22.949839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:22.950463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:22.957279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:22.957771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:22.958600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:22.959053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:23.093200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:23.101651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:23.103312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:23.104493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-767a2e7f-fb1d-410f-ab1e-01b420fbbc4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.158884 May 11 06:01:23.105639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 281/549] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:22 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:23.652738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:23.653287 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:23.659561 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:23.660002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:23.660759 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:23.661199 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:23.790466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:23.798481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3faf30ee-6c77-4a65-be40-33ed9eafe3a6 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1514 microversion: 2.1 time: 0.149705 May 11 06:01:23.799044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 269/550] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:23 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:24.124095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:24.124703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:24.130911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:24.131357 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:24.132119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:24.132552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:24.565842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:24.574100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:24.575573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:24.576734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-83d8d126-9ac7-4104-aea2-2a33a99b715a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.457435 May 11 06:01:24.577299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 282/551] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:24 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:24.817247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:24.818465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:24.826551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:24.827206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:24.828129 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:24.828871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:24.884558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-4155eac6-6038-4251-acb8-dab1da981a2b req-95de58d4-4131-4dc9-b1ce-7b7144837d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62149b5e-614b-41ef-9fda-7bf2b5175152", "name": "network-vif-deleted", "tag": "a8ed2477-82f2-43ee-bbb9-7f2f47a66b02"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:24.893782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-4155eac6-6038-4251-acb8-dab1da981a2b req-95de58d4-4131-4dc9-b1ce-7b7144837d98 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:24.894229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-4155eac6-6038-4251-acb8-dab1da981a2b req-95de58d4-4131-4dc9-b1ce-7b7144837d98 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:24.907257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-4155eac6-6038-4251-acb8-dab1da981a2b req-95de58d4-4131-4dc9-b1ce-7b7144837d98 service nova] Creating event network-vif-deleted:a8ed2477-82f2-43ee-bbb9-7f2f47a66b02 for instance 62149b5e-614b-41ef-9fda-7bf2b5175152 on hv-cinder-73362 May 11 06:01:24.910746 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-4155eac6-6038-4251-acb8-dab1da981a2b req-95de58d4-4131-4dc9-b1ce-7b7144837d98 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030345 May 11 06:01:24.911365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:24.911537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 283/552] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:24.919715 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-17c59869-1c32-4f60-877e-8055ffd5b5cb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1472 microversion: 2.1 time: 0.107362 May 11 06:01:24.920286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 270/553] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:24 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1472 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:25.595556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:25.596276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:25.602231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:25.602680 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:25.603440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:25.603871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:25.736200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:25.744452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:25.746519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:25.747669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-83df84ec-cf86-4f9d-8823-9b96c72d2f43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.156737 May 11 06:01:25.748228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 284/554] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:25 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:25.938113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:25.938929 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:25.945094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:25.945563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:25.946618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:25.947052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:26.016939 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:26.024406 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-71f32a66-c883-4155-801d-9ea0ec81fd6b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 200 len: 1472 microversion: 2.1 time: 0.091901 May 11 06:01:26.024975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 271/555] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:25 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:26.767579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:26.768193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:26.774779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:26.775238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:26.776005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:26.776949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:26.905646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:26.913909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:26.915402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:26.916551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0231dde4-0d62-4e2f-88a6-1069aadd9c64 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.153922 May 11 06:01:26.917942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 285/556] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:26 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:27.042200 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:27.042839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: 62149b5e-614b-41ef-9fda-7bf2b5175152] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:27.049169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:27.049658 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:27.050423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:27.050850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:27.070269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] HTTP exception thrown: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Request method failure captured: May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 HTTP/1.1 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1DQehkcTLKz8aQZiKKC_pOhqfbm5NAiVEgfU8IymMKq87xwnpEyuCKlHTEh5inltTG7qqXDIlJGNQDLNJFavM-b66RF97JmrnodU1_2RKj2dGzsLi2aV_hHwJwzbMGjl5Bz3sqGHLlP__6A2ajiK7oCGLbmk99cXEnjgG3IcpIX8ik May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 3a889575293f48af826e9734868e2714 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:01:27.071912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3a889575293f48af826e9734868e2714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3a889575293f48af826e9734868e2714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a889575293f48af826e9734868e2714"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a889575293f48af826e9734868e2714"}]}] May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 3a889575293f48af826e9734868e2714 May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesSnapshotTestJSON-1056106872-project May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: c054038efc2741ba951666abb68e1cf7 May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesSnapshotTestJSON-1056106872-project May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. May 11 06:01:27.074027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '62149b5e-614b-41ef-9fda-7bf2b5175152'} May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:01:27.075065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. May 11 06:01:27.076407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:27.078441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Returning 404 to user: Instance 62149b5e-614b-41ef-9fda-7bf2b5175152 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:01:27.078441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-37f3ef81-db22-4933-b51d-7bf8dd2b2ba8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152" status: 404 len: 111 microversion: 2.1 time: 0.035003 May 11 06:01:27.078441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 272/557] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:27 2022] GET /compute/v2.1/servers/62149b5e-614b-41ef-9fda-7bf2b5175152 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:01:27.936709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:27.937321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:27.943633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:27.944084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:27.944852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:27.945291 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:28.074929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:28.083271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:28.084789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:28.085961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-71359365-d063-4c81-8ed6-7d1069f3fdaa tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.153737 May 11 06:01:28.086519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 286/558] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:27 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:29.104399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:29.105383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:29.111832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:29.112276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:29.113039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:29.113486 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:29.247094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:29.255814 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:29.257333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:29.258549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4da637b4-e436-4c9b-93ed-e80f38a522fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.158176 May 11 06:01:29.259313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 273/559] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:29 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:30.278099 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:30.278717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:30.285180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:30.285676 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:30.286462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:30.286915 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:30.412598 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:30.421733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:30.423254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:30.424500 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3df5c537-eccc-4674-aca6-fc10fb84c20c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.150982 May 11 06:01:30.425062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 287/560] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:30 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:31.444136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:31.444765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:31.452906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:31.453437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:31.454255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:31.454697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:31.586195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:31.595168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:31.596660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:31.597831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b9ea8e5e-e30e-41e0-8fd7-b30ffa42ba24 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.158180 May 11 06:01:31.598381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 274/561] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:31 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:32.616621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:32.617233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:32.624271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:32.624727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:32.625526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:32.625970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:32.754847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:32.763605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:32.765098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:32.766530 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e14c6d6a-f016-4384-b5ef-19b431f4ca4c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.153794 May 11 06:01:32.767089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 288/562] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:32 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:33.508046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:33.508675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:33.518845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.519292 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.520077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.520501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.545775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-dced1b43-a3ed-429f-a6a1-05b4a272f906 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/ips" status: 200 len: 150 microversion: 2.1 time: 0.042053 May 11 06:01:33.546357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 275/563] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:01:33 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:33.556955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "427a6fb7-2891-423e-b270-456adba2c401"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:33.558110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:33.564641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.565091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.565909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.566346 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.647444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: POST /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/os-volume_attachments HTTP/1.1 May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 74 May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:01:33.649146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {"volumeAttachment": {"volumeId": "427a6fb7-2891-423e-b270-456adba2c401"}} May 11 06:01:33.650705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'server_id': 'f582d9e6-0bc1-47e8-9500-9c7501f659ac', 'body': {'volumeAttachment': {'volumeId': '427a6fb7-2891-423e-b270-456adba2c401'}}} May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:33.651655 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:33.653460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 400 to user: Invalid volume: volume 427a6fb7-2891-423e-b270-456adba2c401 is already attached to instances: 82b2d041-06d4-4ffe-925b-2dead207e93f {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:01:33.654851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4caa6867-0bb4-4be5-b91e-8cac9990fc05 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101386 May 11 06:01:33.655281 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 289/564] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:01:33 2022] POST /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:01:33.662945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:33.663534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:33.670231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.670749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.671581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.672082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.696074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:01:33.774260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e32a0371-599e-4932-ad58-6ead416e7182 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 204 len: 0 microversion: 2.1 time: 0.114586 May 11 06:01:33.774734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 276/565] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:01:33 2022] DELETE /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:01:33.784384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:33.784813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:33.784995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:33.785543 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:33.791407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.791731 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.791852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.792189 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.792629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.793062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:33.793627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.793727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:33.921118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:33.923770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:33.929725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:33.930872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fc9f3818-3a1c-40c6-afe3-3717df879a65 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1682 microversion: 2.1 time: 0.150333 May 11 06:01:33.931226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:33.931430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 290/566] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:33 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:33.932461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-97a8f872-2998-4135-8a45-6cba20fb5c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.151677 May 11 06:01:33.933080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 277/567] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:33 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:34.950158 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:34.950776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:34.950911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:34.951500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:34.957173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:34.957651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:34.957821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:34.958268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:34.958412 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:34.958844 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:34.959036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:34.959473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:35.091962 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:35.093399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:35.099538 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-77abad4c-bfc4-439b-9058-243bd891f2c8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1682 microversion: 2.1 time: 0.153672 May 11 06:01:35.100134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 291/568] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:34 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:35.102376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:35.104062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:35.105840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f079da63-42b3-4b5f-9166-47997585a329 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.158435 May 11 06:01:35.106384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 278/569] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:34 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:36.117631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:36.118244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:36.124626 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:36.125234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:36.125820 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:36.126282 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:36.127061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:36.127505 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:36.131640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:36.132092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:36.132861 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:36.133297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:36.258398 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:36.262874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:36.266307 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-54502c3e-9908-4238-95fb-470a88bf3a30 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1682 microversion: 2.1 time: 0.152252 May 11 06:01:36.266883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 292/570] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:36 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:36.271588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:36.273084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:36.274257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-434ac54b-cf50-4e83-b620-d25000f42c43 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.154190 May 11 06:01:36.274803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 279/571] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:36 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:37.283234 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:37.283854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:37.290516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:37.290973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:37.291780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:37.291913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:37.292373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:37.292583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:37.299008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:37.299491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:37.300387 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:37.300849 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:37.425198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:37.433642 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9ae41a40-001f-4901-93b7-6a05a0285f4e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1682 microversion: 2.1 time: 0.153661 May 11 06:01:37.434507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 293/572] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:37 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:37.444532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:37.453061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:37.454569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:37.455751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-33979a81-330d-489f-a03e-0b24474d31be tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.167683 May 11 06:01:37.456448 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 280/573] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:37 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:37.671413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-ce47f6ab-a532-493c-9841-ddf866933472 req-841b46f6-44eb-4030-a754-4d12657ba4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "name": "network-vif-plugged", "status": "completed", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:37.680926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-ce47f6ab-a532-493c-9841-ddf866933472 req-841b46f6-44eb-4030-a754-4d12657ba4e4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:37.681505 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-ce47f6ab-a532-493c-9841-ddf866933472 req-841b46f6-44eb-4030-a754-4d12657ba4e4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:37.694835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-ce47f6ab-a532-493c-9841-ddf866933472 req-841b46f6-44eb-4030-a754-4d12657ba4e4 service nova] Creating event network-vif-plugged:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 06:01:37.704278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-ce47f6ab-a532-493c-9841-ddf866933472 req-841b46f6-44eb-4030-a754-4d12657ba4e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038715 May 11 06:01:37.705412 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 294/574] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:38.383836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-03778151-1abe-4576-bfb4-ab7ab26aab11 req-f9d13300-2cb1-4be8-a480-eb8d0ca78fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f582d9e6-0bc1-47e8-9500-9c7501f659ac", "name": "network-vif-deleted", "tag": "034c673a-cd22-42e5-bff2-855d7907c09a"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:38.393926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-03778151-1abe-4576-bfb4-ab7ab26aab11 req-f9d13300-2cb1-4be8-a480-eb8d0ca78fcf service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:38.394364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-03778151-1abe-4576-bfb4-ab7ab26aab11 req-f9d13300-2cb1-4be8-a480-eb8d0ca78fcf service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:38.406597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-03778151-1abe-4576-bfb4-ab7ab26aab11 req-f9d13300-2cb1-4be8-a480-eb8d0ca78fcf service nova] Creating event network-vif-deleted:034c673a-cd22-42e5-bff2-855d7907c09a for instance f582d9e6-0bc1-47e8-9500-9c7501f659ac on hv-cinder-73362 May 11 06:01:38.413239 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-03778151-1abe-4576-bfb4-ab7ab26aab11 req-f9d13300-2cb1-4be8-a480-eb8d0ca78fcf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032877 May 11 06:01:38.413954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 281/575] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:38.451386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:38.452200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:38.458254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:38.458709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:38.459486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:38.460113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:38.474751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:38.475653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:38.484119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:38.484781 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:38.485748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:38.486356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:38.537128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:38.545665 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bfe3607e-740f-490d-b697-626424b5bc5a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1614 microversion: 2.1 time: 0.098955 May 11 06:01:38.546388 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 295/576] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:38 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:38.631361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:38.641716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:38.643444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:38.644798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2083ee47-a27b-46b7-b2a0-df49908c9b4e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.174265 May 11 06:01:38.645761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 282/577] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:38 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:39.564008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:39.564627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:39.571220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:39.571673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:39.572449 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:39.573047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:39.642715 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:39.650067 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e477091c-c41e-4fc3-9b62-3c1edd51060b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1614 microversion: 2.1 time: 0.090418 May 11 06:01:39.650638 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 296/578] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:39 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:39.665692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:39.666450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:39.672845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:39.673291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:39.674085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:39.674688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:39.810369 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:39.819219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:39.820723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:39.821897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-40682992-5f5c-4fb3-93d1-9f9f7582fc8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.160249 May 11 06:01:39.822443 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 283/579] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:39 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:40.666954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:40.668066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:40.674489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:40.674981 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:40.675763 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:40.676211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:40.753155 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:40.762908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bd1e72d1-23d8-4d68-a075-67cd881cffd9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1614 microversion: 2.1 time: 0.099648 May 11 06:01:40.769260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 297/580] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:40 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:40.841571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:40.842201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:40.849107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:40.849592 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:40.850378 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:40.850815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:41.004392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:41.013493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:41.015009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:41.016447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-686a4181-4ff3-4890-8285-4513c47dce98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.179752 May 11 06:01:41.017009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 284/581] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:40 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:41.780824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:41.781437 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:41.787793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:41.788246 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:41.789013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:41.789452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:41.820429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:41.820875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:41.821369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'fault' on Instance uuid f582d9e6-0bc1-47e8-9500-9c7501f659ac {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:41.861207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:41.868472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-28bef570-10c0-42ee-a69a-c371db49195c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1331 microversion: 2.1 time: 0.092076 May 11 06:01:41.868999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 298/582] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:41 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:42.034843 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:42.035459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:42.041707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:42.042700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:42.043553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:42.043989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:42.177054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:42.187133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:42.188821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:42.190102 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1d1ee56c-446f-4ca2-98de-69575dc635c4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.159001 May 11 06:01:42.190742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 285/583] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:42 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:42.885772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:42.886378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:42.892958 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:42.893347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:42.894133 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:42.894566 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:42.924506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:42.924975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:42.925427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'fault' on Instance uuid f582d9e6-0bc1-47e8-9500-9c7501f659ac {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:42.966266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:42.973453 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7b10a5eb-9bad-4b62-85f8-bafa285223f2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1331 microversion: 2.1 time: 0.091513 May 11 06:01:42.974038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 299/584] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:42 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1331 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:43.208067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:43.208670 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:43.215245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:43.215681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:43.216437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:43.216868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:43.350074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:43.358337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:43.359819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:43.360954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d6cbb420-dd1f-45bf-932e-958e4fc12892 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.156824 May 11 06:01:43.361524 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 286/585] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:43 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:43.989983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:43.990606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:43.997583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:43.998046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:43.998830 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:43.999274 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:44.033271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:44.033759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:44.034215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'fault' on Instance uuid f582d9e6-0bc1-47e8-9500-9c7501f659ac {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:44.076970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:44.084201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ab69a5d8-50ac-4869-aaac-57644f66a3cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 200 len: 1331 microversion: 2.1 time: 0.098085 May 11 06:01:44.084777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 300/586] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:43 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:44.379342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:44.380083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:44.387734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:44.388240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:44.389247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:44.389773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:44.521161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:44.530246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:44.531784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:44.532933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a68364d7-0547-494d-bed6-1c9d32a97735 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.157577 May 11 06:01:44.533512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 287/587] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:44 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:45.101799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:45.102417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:45.109343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.109867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.110637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.111083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.125865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac HTTP/1.1 May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:01:45.127502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:01:45.129215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'f582d9e6-0bc1-47e8-9500-9c7501f659ac'} May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:01:45.130238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:01:45.131403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:01:45.132608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:01:45.132608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-123e6494-151e-43df-84f5-b2570d10a4dd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 404 len: 111 microversion: 2.1 time: 0.030996 May 11 06:01:45.132608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 301/588] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:45 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:01:45.138024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c007d9da-b1a4-49e0-ae28-7aa0abd8b6f4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '.version_select at 0x7fa13adbe940>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:45.160030 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c007d9da-b1a4-49e0-ae28-7aa0abd8b6f4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079623409" status: 202 len: 0 microversion: 2.1 time: 0.025920 May 11 06:01:45.160604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 288/589] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 06:01:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2079623409 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:01:45.241340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1979873524", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "networks": [{"uuid": "47906bd0-63f9-491c-b0c1-1841c8a98974"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:45.294007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] validate_networks() for [('47906bd0-63f9-491c-b0c1-1841c8a98974', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:01:45.551216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:45.552518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:45.559141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.559583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.560352 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.560775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.638564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:01:45.638987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:01:45.639460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:01:45.639869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:01:45.640280 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:01:45.649085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.649557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.650363 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:45.650800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:45.669260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Getting quotas for project 3a889575293f48af826e9734868e2714. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:01:45.673370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Getting quotas for user c054038efc2741ba951666abb68e1cf7 and project 3a889575293f48af826e9734868e2714. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:01:45.684842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:01:45.687190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:01:45.734586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-10b5f44e-36d7-4756-9503-ee811e5b7324 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497014 May 11 06:01:45.739973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 302/590] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:01:45.742838 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:45.748373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2f8a29ea-5203-435e-a5d6-dd4ba26aebbd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:45.749176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2f8a29ea-5203-435e-a5d6-dd4ba26aebbd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:45.767344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:45.769774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:45.771506 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1257f987-eaa0-4201-ab13-3b68cb368357 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.223710 May 11 06:01:45.772358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 289/591] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:45 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:01:45.821818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2f8a29ea-5203-435e-a5d6-dd4ba26aebbd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:45.830486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2f8a29ea-5203-435e-a5d6-dd4ba26aebbd tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1219 microversion: 2.1 time: 0.088600 May 11 06:01:45.831230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 303/592] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:45 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:46.085306 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:46.085919 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:46.094883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.095383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.096864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.097898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.191298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'services' on Instance uuid 82b2d041-06d4-4ffe-925b-2dead207e93f {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:01:46.264909 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fbcf6dbe-63ba-44be-bb82-820a6e077846 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments/427a6fb7-2891-423e-b270-456adba2c401" status: 202 len: 0 microversion: 2.1 time: 0.183265 May 11 06:01:46.266049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 290/593] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:01:46 2022] DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments/427a6fb7-2891-423e-b270-456adba2c401 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:01:46.276968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:46.279064 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:46.289571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.289877 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.290681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.291147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.326296 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e92f8146-255a-4935-bb86-aa96f5bb89a4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055332 May 11 06:01:46.327086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 304/594] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:01:46 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:46.790606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:46.791928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:46.798933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.799382 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.800142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.800576 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.847968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:46.848577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:46.854424 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.855722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.856495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:46.856930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:46.922778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:46.930748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9d27c159-f0b3-4534-83b4-de28ca3ac102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1271 microversion: 2.1 time: 0.086521 May 11 06:01:46.931526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 305/595] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:46 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:46.947039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:46.955905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:46.957415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:46.958599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e397e790-eb4b-43ab-8a1d-f9ce5eda8b84 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1809 microversion: 2.20 time: 0.172825 May 11 06:01:46.959176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 291/596] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:46 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:47.337807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:47.338691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:47.345876 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.346326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:47.347101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.347542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:47.378985 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c14907d3-eeae-4a75-9525-15a40ca032fd tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 May 11 06:01:47.379606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 306/597] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:01:47 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:47.947879 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:47.949213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:47.955654 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.956102 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:47.956866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.957294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:47.980913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:47.981674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:47.988324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.988783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:47.989603 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:47.990044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.037920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:48.046373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c6131110-e2cb-43e6-9da4-85f335018b83 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1277 microversion: 2.1 time: 0.102290 May 11 06:01:48.046948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 292/598] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:47 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1277 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:48.200445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:48.209598 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:48.211236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:48.212547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8e8107d1-7361-42f8-95f8-d3ed45a1a12f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1796 microversion: 2.20 time: 0.238823 May 11 06:01:48.213111 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 307/599] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:01:47 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1796 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:01:48.392061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:48.393296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:48.399465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.400022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.401074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.402195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.437423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-97a33088-a3ca-440c-b766-33e1ccab1f10 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050277 May 11 06:01:48.438719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 293/600] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:01:48 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:01:48.498192 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:48.498787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:48.505139 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.505914 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.506889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.507326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.536203 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:01:48.631630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-262eec29-aeca-4e48-93be-7b6da83d1035 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 204 len: 0 microversion: 2.1 time: 0.137015 May 11 06:01:48.632840 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 308/601] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:01:48 2022] DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:01:48.642331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:48.642949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:48.650501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.651157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.653101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:48.653800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:48.825622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:48.833622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bf49adf6-c71f-45cf-98b0-f69fca28baca tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1680 microversion: 2.1 time: 0.196049 May 11 06:01:48.834205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 294/602] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:48 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1680 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:48.995757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-2c90edb9-54f2-40f0-a191-ad0ee147fe0b req-17af0bb3-262f-47e3-90ab-f2d646264873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c823e6a3-6d8d-4ab2-868a-d85eed39ced1", "tag": "8bd90930-e072-4204-8f1a-43b6651cec1e"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:49.005089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2c90edb9-54f2-40f0-a191-ad0ee147fe0b req-17af0bb3-262f-47e3-90ab-f2d646264873 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:49.005557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2c90edb9-54f2-40f0-a191-ad0ee147fe0b req-17af0bb3-262f-47e3-90ab-f2d646264873 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:49.019383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-2c90edb9-54f2-40f0-a191-ad0ee147fe0b req-17af0bb3-262f-47e3-90ab-f2d646264873 service nova] Creating event network-changed:8bd90930-e072-4204-8f1a-43b6651cec1e for instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 on hv-cinder-73362 May 11 06:01:49.024219 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-2c90edb9-54f2-40f0-a191-ad0ee147fe0b req-17af0bb3-262f-47e3-90ab-f2d646264873 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 May 11 06:01:49.024818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 309/603] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:01:49.063787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:49.064398 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:49.071088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:49.071546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:49.072563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:49.073006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:49.456359 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:49.463628 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-62b98425-fdd8-4494-8509-b627322ab6ce tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.403692 May 11 06:01:49.464245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 295/604] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:49 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:49.852878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:49.853685 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:49.861187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:49.861741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:49.862705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:49.863233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:50.003700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:50.011348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1e2168ea-6afe-49ce-a4d4-9b41562b935b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1680 microversion: 2.1 time: 0.162878 May 11 06:01:50.020883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 310/605] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:49 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:50.481742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:50.482358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:50.489225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:50.489716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:50.490497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:50.490937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:50.673832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:50.681544 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5fa40a18-5991-4728-a4ef-c3d46e2fd528 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.204998 May 11 06:01:50.691952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 296/606] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:50 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:51.044546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:51.045824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:51.052160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:51.052622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:51.053412 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:51.053908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:51.381618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:51.389518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9c885bfd-b37f-4ef5-a574-e7f76ca5a5b5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1680 microversion: 2.1 time: 0.357383 May 11 06:01:51.394713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 311/607] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:51 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1680 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:51.699833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:51.700743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:51.711185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:51.712104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:51.713271 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:51.714899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:52.179008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:52.190613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e7c262e4-a00b-4e3e-97ae-17ed8a2ec1fb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.495572 May 11 06:01:52.191076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 297/608] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:51 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:52.411740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:52.418824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:52.426018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:52.426636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:52.428670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:52.429595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:52.506937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:52.516891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-62012c7e-0056-4718-85a0-ef1c9abfcdc2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1612 microversion: 2.1 time: 0.109564 May 11 06:01:52.517784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 312/609] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:52 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1612 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:52.943773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-42207968-f402-423c-b602-279cb71c3308 req-9dc7929c-471b-4b70-bd12-2bc7acfebc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82b2d041-06d4-4ffe-925b-2dead207e93f", "name": "network-vif-deleted", "tag": "4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:52.952654 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-42207968-f402-423c-b602-279cb71c3308 req-9dc7929c-471b-4b70-bd12-2bc7acfebc1a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:52.953372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-42207968-f402-423c-b602-279cb71c3308 req-9dc7929c-471b-4b70-bd12-2bc7acfebc1a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:52.966153 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-42207968-f402-423c-b602-279cb71c3308 req-9dc7929c-471b-4b70-bd12-2bc7acfebc1a service nova] Creating event network-vif-deleted:4f48ba8e-7bc3-4474-a6e1-7ed0f02f496c for instance 82b2d041-06d4-4ffe-925b-2dead207e93f on hv-cinder-73362 May 11 06:01:52.972280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-42207968-f402-423c-b602-279cb71c3308 req-9dc7929c-471b-4b70-bd12-2bc7acfebc1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 May 11 06:01:52.973435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 298/610] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:01:53.208711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:53.210037 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:53.220359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:53.220490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:53.222207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:53.225018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:53.461268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:53.474595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ca00781b-47ec-4c99-a4af-bac0ece15f19 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.269347 May 11 06:01:53.483236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 313/611] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:53 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:53.538730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:53.539716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:53.563787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:53.564629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:53.569198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:53.570991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:53.755433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:53.771499 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e2bf9251-960b-40d0-86c4-5d2f028fcba5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 200 len: 1612 microversion: 2.1 time: 0.239189 May 11 06:01:53.787918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 299/612] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:53 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 1612 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:54.492898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:54.494300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:54.503525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:54.504305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:54.505452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:54.506195 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:54.728535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:54.740851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-78c3610d-7096-4e8e-804c-20b813d6fc62 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.252521 May 11 06:01:54.741585 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 314/613] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:54 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:54.793757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:54.794351 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:54.805795 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:54.806249 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:54.807055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:54.807762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:54.830821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f HTTP/1.1 May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:01:54.832860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:01:54.834522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '82b2d041-06d4-4ffe-925b-2dead207e93f'} May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:01:54.835449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:01:54.837295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:01:54.840370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:01:54.841426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d2ea647c-0ba4-4b6e-912a-7b8a1316fd5b tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 404 len: 111 microversion: 2.1 time: 0.053271 May 11 06:01:54.842490 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 300/614] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:54 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:01:54.851054 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4fac6bd5-4883-40df-b47f-874394898707 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '.version_select at 0x7fa14008d550>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:54.876102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4fac6bd5-4883-40df-b47f-874394898707 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897640579" status: 202 len: 0 microversion: 2.1 time: 0.029118 May 11 06:01:54.876697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 315/615] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 06:01:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897640579 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:01:55.533926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f756a169-c6ed-4e49-9cc1-ebb926f11cd4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: .version_select at 0x7fa13ae52670>, body: {"keypair": {"name": "tempest-keypair-874338336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqghba8x2tXmTMj0LCQd0gafdNHswVJvzqGMobaaOiLF6sSUPLLOmcM06Fn1IJ44e2ESNk5rjsPLvQFKORzUyT/sXN+/TzV1WVUpwPlf1nyNmN67GAicxNETmT2vdK07Q=="}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:55.551232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-f756a169-c6ed-4e49-9cc1-ebb926f11cd4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:01:55.555308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-f756a169-c6ed-4e49-9cc1-ebb926f11cd4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:01:55.585779 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f756a169-c6ed-4e49-9cc1-ebb926f11cd4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058553 May 11 06:01:55.587166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 301/616] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 06:01:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:01:55.759279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:55.760010 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:55.768970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:55.769125 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:55.770003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:55.770624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:55.936479 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:55.947044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-188c29d0-b4be-4203-a624-b3209e97e464 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.192678 May 11 06:01:55.947705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 316/617] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:55 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:56.967227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:56.969159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:56.987555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:56.988521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:56.990136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:56.990776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:57.205907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:57.215331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-dad8af03-99de-4627-b488-5cce3e9862c7 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.254205 May 11 06:01:57.217810 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 302/618] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:56 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:57.702212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1473202282", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dde216-4b2f-4353-ba38-412714627bb9"}], "security_groups": [{"name": "tempest-securitygroup--1324374653"}], "key_name": "tempest-keypair-874338336", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:01:57.821202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] validate_networks() for [('28dde216-4b2f-4353-ba38-412714627bb9', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:01:58.247219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:58.249256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:58.256882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:58.257642 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:58.258621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:58.262626 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:58.285345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:01:58.288812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:01:58.290688 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:01:58.291109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:01:58.291564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:01:58.311043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:58.311490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:58.312293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:58.316929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:58.368400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:01:58.378056 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:01:58.407820 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:01:58.416765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:01:58.523174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dad05c72-ee28-46b5-b211-aadc4e1c6ae7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825851 May 11 06:01:58.524573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 317/619] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:01:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:01:58.542077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fe3d2a47-2a24-4cd5-8a9d-4d9754140159 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:58.543126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fe3d2a47-2a24-4cd5-8a9d-4d9754140159 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:58.575314 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:58.587191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-94d37fd5-0c97-4ba1-864b-d02f9464df5a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.357859 May 11 06:01:58.602196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 303/620] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:58 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:01:58.722589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fe3d2a47-2a24-4cd5-8a9d-4d9754140159 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:58.736511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fe3d2a47-2a24-4cd5-8a9d-4d9754140159 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1241 microversion: 2.1 time: 0.204980 May 11 06:01:58.748276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 318/621] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:58 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1241 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:59.610631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:59.611245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:59.620901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:59.621336 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:59.626593 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:59.629406 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:59.756847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:01:59.757509 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:01:59.775879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:59.777331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:59.782737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:01:59.783694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:01:59.866802 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:59.868594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:01:59.877117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-81d3b7a2-607f-4c31-afca-4ae4d076abdb tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.270308 May 11 06:01:59.877268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3dc0bf82-423d-4724-a28b-7ea142947034 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1293 microversion: 2.1 time: 0.125959 May 11 06:01:59.879093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 304/622] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:59 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:01:59.906315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 319/623] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:01:59 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:00.802914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-4c19f63d-36c3-4e07-a787-cc63a4a91817 req-224f7958-c906-4ae4-8391-4eb441702edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c823e6a3-6d8d-4ab2-868a-d85eed39ced1", "name": "network-vif-plugged", "status": "completed", "tag": "8bd90930-e072-4204-8f1a-43b6651cec1e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:00.814014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-4c19f63d-36c3-4e07-a787-cc63a4a91817 req-224f7958-c906-4ae4-8391-4eb441702edb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:00.814582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-4c19f63d-36c3-4e07-a787-cc63a4a91817 req-224f7958-c906-4ae4-8391-4eb441702edb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:00.840880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "535edb90-ef57-41c6-ba4b-9d3ee628bc5c"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:00.842422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:00.898973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:00.900036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-4c19f63d-36c3-4e07-a787-cc63a4a91817 req-224f7958-c906-4ae4-8391-4eb441702edb service nova] Creating event network-vif-plugged:8bd90930-e072-4204-8f1a-43b6651cec1e for instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 on hv-cinder-73362 May 11 06:02:00.900230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:00.906144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:00.907508 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:00.936229 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-4c19f63d-36c3-4e07-a787-cc63a4a91817 req-224f7958-c906-4ae4-8391-4eb441702edb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135340 May 11 06:02:00.937193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 305/624] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:00.971051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:00.972661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:00.985235 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:00.985488 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:00.986519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:00.987107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:01.474722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f7d54bbf-c4d7-4e1b-ac97-c6f81b4a15b6 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637708 May 11 06:02:01.476057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 320/625] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:02:00 2022] POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:01.528255 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:01.530842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:01.553150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:01.555819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:01.577389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:01.591491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:01.690602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:01.699313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8be0f771-5a87-463a-bedf-64edafcfd09a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1299 microversion: 2.1 time: 0.221171 May 11 06:02:01.699968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 321/626] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:01 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1299 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:01.965122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:01.981118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a38738c0-0d57-4594-be9f-fd45ac8a0bba tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 1.032385 May 11 06:02:01.983539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7387e17c-54c7-497b-a581-98ba325ea71b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Action: 'create', calling method: .version_select at 0x7fa14008e1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1484454940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNNg4CaQ8kYIQ6Et6wT5sJLD/sdR0teeXyzWFxdfxNguH42C1SstogQZdldfajk/ah9zim4mikwzWDkghBHPpRFcodBQYCP6RgXq0y/v/2VYpAeAycO/hj7o07oCn2aFA=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:01.984305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 306/627] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:00 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:02.000805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-7387e17c-54c7-497b-a581-98ba325ea71b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Getting quotas for project 3071f6c8fd64408fa45be4bc3a5c3f4d. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:02:02.005519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-7387e17c-54c7-497b-a581-98ba325ea71b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Getting quotas for user 70d3a9e2d0a14433a9a8627d15b07ff1 and project 3071f6c8fd64408fa45be4bc3a5c3f4d. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:02:02.032469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7387e17c-54c7-497b-a581-98ba325ea71b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331079 May 11 06:02:02.033384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 322/628] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 06:02:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:02.717042 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:02.717718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:02.725057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:02.725425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:02.726225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:02.726655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:02.873206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:02.881685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-acf4442a-1dd1-46ab-8420-7b372400b602 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.169342 May 11 06:02:02.882916 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 307/629] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:02 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:03.001304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:03.002168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:03.009564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.010174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.011165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.011669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.158875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:03.167313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f8a68494-40dc-466c-89b5-99f4d4015d81 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1319 microversion: 2.1 time: 0.169360 May 11 06:02:03.168210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 323/630] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:02 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:03.813216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-0c97f1c1-2730-4824-b5c5-31f2bb1bab26 req-77183868-c8ec-4ecc-9885-44a4d06471f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4efab7ed-d556-45bf-b471-e4783656823e", "tag": "fc5e2573-0bba-471d-82b1-607439df47ab"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:03.827290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0c97f1c1-2730-4824-b5c5-31f2bb1bab26 req-77183868-c8ec-4ecc-9885-44a4d06471f2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.827740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0c97f1c1-2730-4824-b5c5-31f2bb1bab26 req-77183868-c8ec-4ecc-9885-44a4d06471f2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.859755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-0c97f1c1-2730-4824-b5c5-31f2bb1bab26 req-77183868-c8ec-4ecc-9885-44a4d06471f2 service nova] Creating event network-changed:fc5e2573-0bba-471d-82b1-607439df47ab for instance 4efab7ed-d556-45bf-b471-e4783656823e on hv-cinder-73362 May 11 06:02:03.879555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-0c97f1c1-2730-4824-b5c5-31f2bb1bab26 req-77183868-c8ec-4ecc-9885-44a4d06471f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064454 May 11 06:02:03.880232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 308/631] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:03.911077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:03.911077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:03.926483 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.928766 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.930824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.931929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.961808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:03.962799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:03.988363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.989839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:03.992713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:03.994670 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:04.133454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lazy-loading 'services' on Instance uuid af7c8f3d-2da4-4399-ac9d-42f991a37c96 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:04.213868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:04.237644 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a084b243-7882-4cc2-966a-4d0c2424c7f8 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.340801 May 11 06:02:04.238278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 324/632] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:03 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:04.238987 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b81fb515-11ef-482b-ad43-e8376d5efcc6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments/7741bf15-1936-4ed9-8ed8-052c1ce57c09" status: 202 len: 0 microversion: 2.1 time: 0.279591 May 11 06:02:04.243556 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 309/633] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:02:03 2022] DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments/7741bf15-1936-4ed9-8ed8-052c1ce57c09 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:02:04.274985 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:04.276925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:04.284930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:04.286481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:04.287487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:04.287927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:04.467789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:04.479791 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0a7a6c06-d714-4f56-9ede-dd409d4fe77f tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1508 microversion: 2.1 time: 0.213502 May 11 06:02:04.481310 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 325/634] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:04 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:04.499754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0e23ec7-6bfb-489d-84cd-15e3b7b10d29", "device": "/dev/sdb"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:04.503898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:04.514857 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:04.515308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:04.516557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:04.517254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:04.895787 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d4131f5d-a6f9-4b6f-9b49-8c3492131344 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "POST /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402482 May 11 06:02:04.901940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 310/635] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:02:04 2022] POST /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:05.255597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:05.256409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:05.270586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:05.275741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:05.277711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:05.278390 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:05.438931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:05.449193 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5aa83ead-6283-4353-84b7-bbd00a4128e9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.196887 May 11 06:02:05.450273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 326/636] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:05 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:06.467464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:06.468253 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:06.474689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:06.475133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:06.475901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:06.476332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:06.611230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:06.618571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2cc80bf1-99b3-4aac-96c9-ac876093c258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.156423 May 11 06:02:06.619138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 311/637] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:06 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:07.635758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:07.636370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:07.643018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:07.643470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:07.644239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:07.644676 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:07.772956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:07.780605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-84eda4b5-58bf-47b9-bf20-862d3642b964 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.148670 May 11 06:02:07.781209 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 327/638] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:07 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:08.797446 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:08.798096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:08.804831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:08.805182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:08.806009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:08.806449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:08.933268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:08.943386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bf324fdd-28cf-4438-b39d-8ec720470d70 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.149764 May 11 06:02:08.944300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 312/639] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:08 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:09.960976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:09.961720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:09.968175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:09.968629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:09.969404 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:09.969883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.098171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:10.106213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f02d063a-cbc7-475e-91ab-8d40243f30b2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.149649 May 11 06:02:10.107084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 328/640] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:09 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:10.209770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:10.210775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:10.218597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.219049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.219805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.220274 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.243334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'flavor' on Instance uuid 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:10.336988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-100966098"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:10.337550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:10.346663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.347376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.348448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.349065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.398835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fa5a546a-b167-4c80-970d-4d6ecb1b8cd8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/action" status: 200 len: 32 microversion: 2.1 time: 0.193674 May 11 06:02:10.399511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 313/641] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:02:10 2022] POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:02:10.409656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:10.410396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:10.417789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.418518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.419463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.420073 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.515949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.network.security_group_api [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Removing security group b0958a3c-394f-4d46-a040-c0426f6f3bb1 from port 0ab1918d-6a5d-41ef-a74b-b96667049a93 May 11 06:02:10.684430 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:10.700039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7b1b03a7-2329-4137-9ce8-c284da4076d5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.294462 May 11 06:02:10.700914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 314/642] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:10 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:10.705552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-35a393c0-05bd-46b9-abe4-f73d304141a4 req-f16a6477-751e-402d-aa1c-3d7759d6167b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efab7ed-d556-45bf-b471-e4783656823e", "name": "network-vif-plugged", "status": "completed", "tag": "fc5e2573-0bba-471d-82b1-607439df47ab"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:10.716323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-35a393c0-05bd-46b9-abe4-f73d304141a4 req-f16a6477-751e-402d-aa1c-3d7759d6167b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.717623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-35a393c0-05bd-46b9-abe4-f73d304141a4 req-f16a6477-751e-402d-aa1c-3d7759d6167b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.736055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-35a393c0-05bd-46b9-abe4-f73d304141a4 req-f16a6477-751e-402d-aa1c-3d7759d6167b service nova] Creating event network-vif-plugged:fc5e2573-0bba-471d-82b1-607439df47ab for instance 4efab7ed-d556-45bf-b471-e4783656823e on hv-cinder-73362 May 11 06:02:10.741929 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-35a393c0-05bd-46b9-abe4-f73d304141a4 req-f16a6477-751e-402d-aa1c-3d7759d6167b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039176 May 11 06:02:10.742760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 315/643] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:10.747808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d898c59b-e98d-433f-a2d8-29d87fe4ba17 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:10.754405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d898c59b-e98d-433f-a2d8-29d87fe4ba17 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.754588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d898c59b-e98d-433f-a2d8-29d87fe4ba17 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.782026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d898c59b-e98d-433f-a2d8-29d87fe4ba17 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Going to try to stop instance {{(pid=117335) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 06:02:10.843820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d898c59b-e98d-433f-a2d8-29d87fe4ba17 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action" status: 202 len: 0 microversion: 2.1 time: 0.099728 May 11 06:02:10.845532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 316/644] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:02:10 2022] POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:02:10.854768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:10.856609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:10.864026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.864740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.866092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:10.866597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:10.978863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ef2ade00-57a6-44bc-98e8-2962ff50a9cd tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action" status: 202 len: 0 microversion: 2.1 time: 0.646610 May 11 06:02:10.982795 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 329/645] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:02:10 2022] POST /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:02:10.988836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-00311b91-9ec1-486d-aacb-dc4b3bfad08e req-b3a864a5-d65d-4175-b18f-10e50d6fa9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:11.005334 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-00311b91-9ec1-486d-aacb-dc4b3bfad08e req-b3a864a5-d65d-4175-b18f-10e50d6fa9b8 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:11.006136 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-00311b91-9ec1-486d-aacb-dc4b3bfad08e req-b3a864a5-d65d-4175-b18f-10e50d6fa9b8 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:11.028083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-00311b91-9ec1-486d-aacb-dc4b3bfad08e req-b3a864a5-d65d-4175-b18f-10e50d6fa9b8 service nova] Creating event network-changed:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 06:02:11.040304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-00311b91-9ec1-486d-aacb-dc4b3bfad08e req-b3a864a5-d65d-4175-b18f-10e50d6fa9b8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055043 May 11 06:02:11.043763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:11.054374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-200fff38-3d01-4904-b847-aefc92075474 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.205363 May 11 06:02:11.055274 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 317/646] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:10 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:11.055613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 330/647] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:02:11.124459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:11.125405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:11.134426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:11.134974 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:11.136810 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:11.137252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:11.437059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:11.457144 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-39b20469-3311-4b11-a618-c7ac2a1a3396 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.337394 May 11 06:02:11.461837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 318/648] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:11 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:11.719439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:11.720463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:11.726970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:11.727353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:11.728151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:11.728626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.073765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:12.074386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:12.080281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.080731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.081527 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.081970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.128433 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:12.137297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fce03ca7-04df-495d-8241-326eb5562dd7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.423426 May 11 06:02:12.138233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 331/649] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:11 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:12.217009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:12.224899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8cba55c9-eb29-4165-920a-26257cebf8f3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.155540 May 11 06:02:12.225466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 319/650] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:12 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:12.478117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:12.478857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:12.485391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.486117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.487847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.488446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.749755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:12.758463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-95846709-72de-4d62-bb44-0d767b1c6a66 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1367 microversion: 2.1 time: 0.284486 May 11 06:02:12.759244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 332/651] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:12 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:12.788289 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:12.788769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:12.795412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.796148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.796915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.797353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.879974 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lazy-loading 'services' on Instance uuid 062320bf-1043-4042-8c15-82cfd3b16686 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:12.950757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0c617aa8-dac8-48ae-91f3-0774dee4cc6f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments/572cac7e-9f6f-47c8-8d81-88ecdbc2740e" status: 202 len: 0 microversion: 2.1 time: 0.166200 May 11 06:02:12.951363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 320/652] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:02:12 2022] DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments/572cac7e-9f6f-47c8-8d81-88ecdbc2740e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:02:12.960496 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:12.961445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:12.967410 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.967856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:12.968625 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:12.969063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.005787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7442714f-570d-4d7e-807b-3874bcf6aacb tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049064 May 11 06:02:13.009640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 333/653] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:12 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:13.072140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-f52d30e5-744a-4940-ae65-8e55b042e769 req-23d77644-24c9-4ff5-afc0-1b1d5de296d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:13.080567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-f52d30e5-744a-4940-ae65-8e55b042e769 req-23d77644-24c9-4ff5-afc0-1b1d5de296d4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.081013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-f52d30e5-744a-4940-ae65-8e55b042e769 req-23d77644-24c9-4ff5-afc0-1b1d5de296d4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.093295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-f52d30e5-744a-4940-ae65-8e55b042e769 req-23d77644-24c9-4ff5-afc0-1b1d5de296d4 service nova] Creating event network-changed:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 06:02:13.098439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-f52d30e5-744a-4940-ae65-8e55b042e769 req-23d77644-24c9-4ff5-afc0-1b1d5de296d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030254 May 11 06:02:13.099036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 321/654] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:13.156676 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:13.158001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:13.164029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.164478 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.165248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.165710 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.244132 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:13.244931 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:13.252211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.252874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.253819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.254709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.308417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:13.337597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-62564385-8a28-4fc0-964e-da857fae2c44 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.174036 May 11 06:02:13.338311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 334/655] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:13 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:13.438760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:13.446101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f59cca46-9368-4ddb-88e4-d578aba81517 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.207154 May 11 06:02:13.446664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 322/656] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:13 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:13.775351 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:13.775969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:13.783006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.783457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.784229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.784780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.917760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:13.925022 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c24ce3a3-e7b8-45b7-ab88-1cc51a55790c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1556 microversion: 2.1 time: 0.153518 May 11 06:02:13.925608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 335/657] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:13 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:13.941261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:13.941820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:13.947556 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.948017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:13.949507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:13.949954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.018235 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:14.019272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:14.025725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.025875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0846c4e6-a13a-405b-bd59-42df5afe8d97 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088325 May 11 06:02:14.026420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.026684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 323/658] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:02:13 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:14.030524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.030972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.060646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6c1393c6-4929-470e-806c-7df0213f724b tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 May 11 06:02:14.061509 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 336/659] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:14 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:02:14.355185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:14.355805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:14.363578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.364025 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.364791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.365360 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.465661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:14.466287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:14.472973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.473872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.475039 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:14.475881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:14.644530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:14.655070 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a3a9b50a-7f5d-40ee-ba9c-3ceb743fa71d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.303911 May 11 06:02:14.664908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 324/660] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:14 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:14.715686 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:14.723722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fcee56d3-036f-443c-a1c9-74f8fab17937 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.262756 May 11 06:02:14.724303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 337/661] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:14 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:15.072667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:15.073922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:15.080187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.080630 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.081392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.081936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.112481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-baf0f55b-112b-4f32-8698-44aa9f3ec8ca tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 May 11 06:02:15.116462 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 325/662] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:15 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:15.420099 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-071759ef-d952-4df4-92bd-06fbc7bced07 req-421cd03c-a9b4-4ec2-9cd9-8e146fbd48a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4efab7ed-d556-45bf-b471-e4783656823e", "tag": "fc5e2573-0bba-471d-82b1-607439df47ab"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:15.429233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-071759ef-d952-4df4-92bd-06fbc7bced07 req-421cd03c-a9b4-4ec2-9cd9-8e146fbd48a9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.429744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-071759ef-d952-4df4-92bd-06fbc7bced07 req-421cd03c-a9b4-4ec2-9cd9-8e146fbd48a9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.441865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-071759ef-d952-4df4-92bd-06fbc7bced07 req-421cd03c-a9b4-4ec2-9cd9-8e146fbd48a9 service nova] Creating event network-changed:fc5e2573-0bba-471d-82b1-607439df47ab for instance 4efab7ed-d556-45bf-b471-e4783656823e on hv-cinder-73362 May 11 06:02:15.446656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-071759ef-d952-4df4-92bd-06fbc7bced07 req-421cd03c-a9b4-4ec2-9cd9-8e146fbd48a9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031676 May 11 06:02:15.447250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 338/663] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:15.674321 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:15.675026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:15.681952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.683953 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.685028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.685725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.741088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:15.741819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:15.749084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.749561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.750942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:15.751739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:15.834673 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:15.843478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e5017293-ddd0-4887-8a54-3d08e7ff1141 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.173977 May 11 06:02:15.844395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 326/664] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:15 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:15.966742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:15.975219 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ab84b547-ac99-4ed6-8bef-d1ecda15d343 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.238328 May 11 06:02:15.975784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 339/665] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:15 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:16.125438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:16.127203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:16.134223 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:16.134875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:16.136581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:16.137141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:16.170583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-78ca9993-56a2-4ba9-85c9-339643f9cd20 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050341 May 11 06:02:16.171427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 327/666] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:16 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:16.861776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:16.862402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:16.868762 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:16.869222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:16.870562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:16.871022 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:16.992801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:16.993406 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:16.996909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:17.000459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:17.000978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:17.001841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:17.002520 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:17.004936 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3d0c0636-9f16-4e0f-98a0-7351c9b7abda tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.147656 May 11 06:02:17.005532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 340/667] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:16 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:17.141063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:17.149352 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3f9d7114-b65c-45b9-aa54-50c1171eb414 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.160383 May 11 06:02:17.150101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 328/668] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:16 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:17.183279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:17.184506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:17.190452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:17.190907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:17.191695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:17.192130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:17.228052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-663e3a73-e27f-48c5-860b-8519a74fcfe1 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049471 May 11 06:02:17.228625 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 341/669] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:17 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:18.023112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:18.023750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:18.030934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.031382 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.032139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.032574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.156380 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:18.164338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4702a63a-cb13-4465-ba8f-c01df1122349 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.145144 May 11 06:02:18.164898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 329/670] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:18 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:18.166828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:18.167444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:18.174162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.174617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.175400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.175836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.239399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:18.240317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:18.247116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.247754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.248535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:18.249147 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:18.278915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-162f093b-5b4a-44c7-b920-191f48268428 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043391 May 11 06:02:18.282894 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 330/671] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:18 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:02:18.307484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:18.315326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f1e87466-60f8-432c-a8e8-eab40a97a7d5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.152421 May 11 06:02:18.315874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 342/672] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:18 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:19.181849 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:19.182398 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:19.189092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.189562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.190328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.190760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.290763 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:19.291784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:19.298899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.299452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.300304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.300863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.320922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:19.329952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e9e7f10a-b552-41bf-b978-62c30bfe3387 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.152071 May 11 06:02:19.330410 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-60780705-56ee-4067-876f-70e162424304 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043913 May 11 06:02:19.330522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 331/673] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:19 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:19.330970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 343/674] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:02:19 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:02:19.334963 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:19.335953 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:19.341005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:19.341673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:19.342851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.343337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.344087 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.344530 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.347800 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.348443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.349213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:19.349672 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:19.469301 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] HTTP exception thrown: Instance 062320bf-1043-4042-8c15-82cfd3b16686 is not attached to volume 572cac7e-9f6f-47c8-8d81-88ecdbc2740e May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Request method failure captured: May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments/572cac7e-9f6f-47c8-8d81-88ecdbc2740e HTTP/1.1 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1CQD7LZ5g1PBft6vBIt-hDNZud8QI2d1roKBwAzzq9He7dokxD9IIzhRoB8bHPOe_vrWZgypg428e0o6eqgq5M_EhLh_VbbRNSYgBMDpdjj7pOTXLRiMK5v5eWfNtzL4quUTXQ9rge-aznbY-ARL7hPPipqdHRznRb5VHtZmQAbRVs May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 4285af910bec40c4a5a5691d5492f941 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:02:19.475492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4285af910bec40c4a5a5691d5492f941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4285af910bec40c4a5a5691d5492f941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4285af910bec40c4a5a5691d5492f941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4285af910bec40c4a5a5691d5492f941"}]}] May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 4285af910bec40c4a5a5691d5492f941 May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-TestMinimumBasicScenario-1346870818-project May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 9f19dad38bba4adb9267a1fcbc26d7b2 May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-TestMinimumBasicScenario-1346870818-project May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:02:19.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 062320bf-1043-4042-8c15-82cfd3b16686 is not attached to volume 572cac7e-9f6f-47c8-8d81-88ecdbc2740e May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'server_id': '062320bf-1043-4042-8c15-82cfd3b16686', 'id': '572cac7e-9f6f-47c8-8d81-88ecdbc2740e'} May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 572cac7e-9f6f-47c8-8d81-88ecdbc2740e. May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:02:19.478172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062320bf-1043-4042-8c15-82cfd3b16686 is not attached to volume 572cac7e-9f6f-47c8-8d81-88ecdbc2740e May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062320bf-1043-4042-8c15-82cfd3b16686 is not attached to volume 572cac7e-9f6f-47c8-8d81-88ecdbc2740e May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:19.479602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Returning 404 to user: Instance 062320bf-1043-4042-8c15-82cfd3b16686 is not attached to volume 572cac7e-9f6f-47c8-8d81-88ecdbc2740e {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:02:19.480813 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a0cafed6-81e8-468f-ba27-a04575261110 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments/572cac7e-9f6f-47c8-8d81-88ecdbc2740e" status: 404 len: 154 microversion: 2.1 time: 0.140252 May 11 06:02:19.480813 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 344/675] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:02:19 2022] DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686/os-volume_attachments/572cac7e-9f6f-47c8-8d81-88ecdbc2740e => generated 154 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:02:19.484551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:19.492190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-58a63eef-f33f-449e-969c-4b8a4216406c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.160739 May 11 06:02:19.492755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 332/676] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:19 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:20.347414 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:20.348124 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:20.356372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:20.356829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:20.357631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:20.358076 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:20.483542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:20.491521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b5c0ab0c-55cc-42ba-8f0c-bec9fe3ec82f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.148121 May 11 06:02:20.492079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 345/677] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:20 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:20.508412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:20.509028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:20.515396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:20.516109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:20.516869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:20.517305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:20.645361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:20.653483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-401af12f-91e2-427f-b4c7-5f5d5ef6185a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.148705 May 11 06:02:20.654083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 333/678] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:20 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:21.509194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:21.509743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:21.517249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:21.517727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:21.518493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:21.518925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:21.646628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:21.656249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-213e4966-46ce-4829-9c53-db405cf39542 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.150903 May 11 06:02:21.656939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 346/679] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:21 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:21.670951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:21.671852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:21.679139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:21.679669 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:21.680516 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:21.680951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:21.808029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:21.815870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8872cabd-415b-4320-a640-93735dee8fbe tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.149449 May 11 06:02:21.816435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 334/680] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:21 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:22.673624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:22.674171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:22.680399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:22.680845 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:22.681636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:22.682071 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:22.810606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:22.818402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5563c435-f6b7-4609-a9a3-8eebff2458f9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.148710 May 11 06:02:22.818969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 347/681] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:22 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:22.832394 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:22.832989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:22.839467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:22.840483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:22.841322 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:22.841782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:22.966800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:22.974126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d4f2393c-e84c-42bd-bc19-3d074d238367 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.145566 May 11 06:02:22.974697 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 335/682] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:22 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:23.757851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:23.758401 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:23.765176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.765899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.766670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.767103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.790470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:02:23.835725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:23.836488 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:23.843444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.844233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.845125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.845601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.867487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e8f3f96f-6841-45c2-a331-a3ef14224e59 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 204 len: 0 microversion: 2.1 time: 0.112803 May 11 06:02:23.868368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 348/683] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:02:23 2022] DELETE /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:02:23.877761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:23.878465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:23.884562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.885008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.885936 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:23.886284 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:23.980998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:23.989173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c06b45bf-661a-448b-8016-94d9074cb724 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.157402 May 11 06:02:23.989727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 336/684] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:23 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:23.994318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:23.994927 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:24.001345 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:24.001985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:24.002760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:24.003201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:24.018401 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:24.025631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-55665783-c1eb-4c91-ae48-4164e553cf0d tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1555 microversion: 2.1 time: 0.152065 May 11 06:02:24.026213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 349/685] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:23 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:24.130791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:24.138276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-14a764ca-3978-4ab8-ab4b-e27821b94d7a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.147579 May 11 06:02:24.138940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 337/686] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:23 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:25.006921 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:25.007516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:25.014607 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.015050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.016081 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.016514 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.042283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:25.042897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:25.049308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.049801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.050569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.050998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.158204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:25.168057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8a643587-b116-44b9-9b0b-fb7acd7b9e01 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.164910 May 11 06:02:25.168736 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 350/687] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:25 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:25.177065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:25.177065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:25.181557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:25.183747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.184353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.185922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:25.186236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:25.192266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-adf31fd0-96d2-456c-8998-5d75fa21e424 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1555 microversion: 2.1 time: 0.153793 May 11 06:02:25.198295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 338/688] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:25 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:25.314090 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:25.321267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d67cd1fe-b49b-4ef3-a705-fd2a67425777 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.151597 May 11 06:02:25.322154 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 351/689] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:25 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:26.185970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:26.186647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:26.192982 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.193422 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.194211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.194641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.210296 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:26.210903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:26.217813 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.218799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.219153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.219591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.334572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:26.343072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-79366adc-26d8-46e5-83eb-df4a977a8551 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.161086 May 11 06:02:26.343652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 339/690] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:26 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:26.348208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:26.348812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:26.353054 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:26.355944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.356390 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.357201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:26.357666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:26.360467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d346e315-268f-438c-ad3f-d1b793a0e6d4 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1555 microversion: 2.1 time: 0.154046 May 11 06:02:26.361038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 352/691] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:26 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:26.482148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:26.489386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b8a9adba-b2bf-4edc-8fd1-5524630db844 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.144799 May 11 06:02:26.489979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 340/692] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:26 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:27.360750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:27.361516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:27.367429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.367899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.368677 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.369114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.376856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:27.377593 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:27.384329 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.384853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.385739 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.386251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.505203 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:27.513260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4e62c08c-8acc-4bb6-a06c-0364d02955e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.156930 May 11 06:02:27.514174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 353/693] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:27 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:27.518951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:27.519559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:27.525514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:27.525913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.526373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.527159 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:27.527600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:27.534003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e54abf28-e913-4344-813d-3fcae38db21f tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1555 microversion: 2.1 time: 0.161130 May 11 06:02:27.534757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 341/694] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:27 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:27.661034 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:27.668368 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a3e93da7-5bde-49cb-b90b-7e46094fcc75 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1678 microversion: 2.1 time: 0.153234 May 11 06:02:27.668932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 354/695] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:27 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:28.374542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-54018682", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1484454940", "security_groups": [{"name": "tempest-secgroup-smoke-1021050266"}], "networks": [{"uuid": "d61038b6-2eb9-43cb-9ba1-5ce8fba4c863"}], "block_device_mapping_v2": [{"uuid": "cfc3c11a-ca35-4f9f-ad0f-332337121157", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:28.487884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] validate_networks() for [('d61038b6-2eb9-43cb-9ba1-5ce8fba4c863', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:02:28.531419 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:28.532046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:28.538058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.538520 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.539317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.539748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.670860 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:28.678650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9976a695-6b48-4083-9ff4-8dc80619c96a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.151488 May 11 06:02:28.679228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 355/696] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:28 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:28.683700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:28.684318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:28.691400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.691853 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.692640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.693092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.824709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:28.832619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7192e89c-bedc-43bc-b4e4-b3164b25986a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1555 microversion: 2.1 time: 0.152416 May 11 06:02:28.833197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 356/697] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:28 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:28.838650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:28.839533 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:28.846841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.847298 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.848468 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.849189 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:02:28.865055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:02:28.865349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:02:28.865799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:02:28.866199 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:02:28.876195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.876961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.877784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:28.878454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:28.898207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Getting quotas for project 3071f6c8fd64408fa45be4bc3a5c3f4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:02:28.902215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Getting quotas for user 70d3a9e2d0a14433a9a8627d15b07ff1 and project 3071f6c8fd64408fa45be4bc3a5c3f4d. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:02:28.961899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:02:28.964059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cfc3c11a-ca35-4f9f-ad0f-332337121157',volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:02:28.992172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:29.000472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3c0922a5-fc01-40d5-a625-e618d452b65a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1655 microversion: 2.1 time: 0.165905 May 11 06:02:29.001137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 357/698] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:28 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:29.017348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8410e888-fc6d-4c5d-9d5d-7f9a2af831a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:29.024052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8410e888-fc6d-4c5d-9d5d-7f9a2af831a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.024589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8410e888-fc6d-4c5d-9d5d-7f9a2af831a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.089121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8410e888-fc6d-4c5d-9d5d-7f9a2af831a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Going to try to start instance {{(pid=117334) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 06:02:29.100820 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-227efdc5-593a-4bb2-b7ef-a9c5408b1776 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730735 May 11 06:02:29.105638 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 342/699] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:02:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:02:29.112145 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-59a0d8d0-7b65-47b7-ab62-702b702da472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:29.113233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-59a0d8d0-7b65-47b7-ab62-702b702da472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:29.136445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8410e888-fc6d-4c5d-9d5d-7f9a2af831a8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action" status: 202 len: 0 microversion: 2.1 time: 0.123405 May 11 06:02:29.140604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 358/700] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:02:29 2022] POST /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:02:29.146709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:29.147536 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:29.154787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.155381 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.156266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.156804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.175752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-59a0d8d0-7b65-47b7-ab62-702b702da472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:29.184047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-59a0d8d0-7b65-47b7-ab62-702b702da472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1087 microversion: 2.1 time: 0.075618 May 11 06:02:29.193799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 343/701] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:29 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:29.331600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:29.344261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-569179df-3a2f-43bd-ab43-816a2c822e82 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1664 microversion: 2.1 time: 0.201471 May 11 06:02:29.353674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 359/702] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:29 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:29.696940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:29.698033 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:29.706018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.706586 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.707513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.708044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.851617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:29.853878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:29.866147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.866976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.868084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:29.868885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:29.941764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:29.950917 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-903952e2-1acd-4e87-81bc-eea9f9017d6d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.258097 May 11 06:02:29.951800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 344/703] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:29 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:30.107743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-956177f8-6d8c-4d88-b281-87438019cf09 req-b6ddf306-1efc-4da3-a9d6-cfb0c329a3c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "062320bf-1043-4042-8c15-82cfd3b16686", "name": "network-vif-deleted", "tag": "0ab1918d-6a5d-41ef-a74b-b96667049a93"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:30.116862 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-956177f8-6d8c-4d88-b281-87438019cf09 req-b6ddf306-1efc-4da3-a9d6-cfb0c329a3c0 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.117582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-956177f8-6d8c-4d88-b281-87438019cf09 req-b6ddf306-1efc-4da3-a9d6-cfb0c329a3c0 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.125027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:30.131090 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-956177f8-6d8c-4d88-b281-87438019cf09 req-b6ddf306-1efc-4da3-a9d6-cfb0c329a3c0 service nova] Creating event network-vif-deleted:0ab1918d-6a5d-41ef-a74b-b96667049a93 for instance 062320bf-1043-4042-8c15-82cfd3b16686 on hv-cinder-73362 May 11 06:02:30.132723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-acfc05f2-c5fe-4bde-a0db-0bb366db8291 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1513 microversion: 2.1 time: 0.285809 May 11 06:02:30.133336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 360/704] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:29 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:30.136650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-956177f8-6d8c-4d88-b281-87438019cf09 req-b6ddf306-1efc-4da3-a9d6-cfb0c329a3c0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 May 11 06:02:30.137246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 345/705] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:30.202373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:30.202988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:30.209232 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.209804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.210835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.211343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.274303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:30.281778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9fe80ffb-64fb-45b7-89ca-f464ac917ed8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1185 microversion: 2.1 time: 0.084373 May 11 06:02:30.282350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 361/706] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:30 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:30.362089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:30.362685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:30.368587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.369032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.369815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.370250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.521446 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:30.529688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8ae7447a-a90a-4808-ab18-9d0f80b9a9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1664 microversion: 2.1 time: 0.172004 May 11 06:02:30.530597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 346/707] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:30 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:30.638619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:30.638946 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:30.645930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.646380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.647189 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.647627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.730676 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lazy-loading 'services' on Instance uuid c823e6a3-6d8d-4ab2-868a-d85eed39ced1 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:30.840884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-301b9657-2ddb-428b-ac6e-d87fe03b4d8b tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1/os-volume_attachments/c0e23ec7-6bfb-489d-84cd-15e3b7b10d29" status: 202 len: 0 microversion: 2.1 time: 0.213984 May 11 06:02:30.841671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 362/708] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:02:30 2022] DELETE /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1/os-volume_attachments/c0e23ec7-6bfb-489d-84cd-15e3b7b10d29 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:02:30.968908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:30.969550 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:30.975895 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.976344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:30.977105 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:30.977568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.103503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:31.111965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cdd488ab-0e72-463d-904b-3505833185a9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.147422 May 11 06:02:31.112695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 347/709] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:30 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:31.150999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:31.151629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:31.159436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.159892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.160672 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.161111 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.195585 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.196040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.196491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lazy-loading 'fault' on Instance uuid 062320bf-1043-4042-8c15-82cfd3b16686 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:31.236880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f19dad38bba4adb9267a1fcbc26d7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4285af910bec40c4a5a5691d5492f941', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:31.244063 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6f707604-7946-4ea5-b811-c3550b37430a tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 200 len: 1349 microversion: 2.1 time: 0.097359 May 11 06:02:31.244630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 363/710] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:31 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:31.300553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:31.301369 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:31.307502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.307958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.308732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.309330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.386692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:31.395132 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-021b4525-5314-4f6e-bfcc-b970d8e2d501 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1203 microversion: 2.1 time: 0.099154 May 11 06:02:31.395708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 348/711] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:31 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:31.547333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:31.547932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:31.553704 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.554173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.554916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:31.555349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:31.686004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:31.693591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-200cf008-0dbd-4481-a900-78d284cf8154 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1668 microversion: 2.1 time: 0.150070 May 11 06:02:31.694160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 364/712] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:31 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:32.129521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:32.130903 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:32.137386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.137920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.138696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.139127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.261663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:32.262313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] [instance: 062320bf-1043-4042-8c15-82cfd3b16686] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:32.270266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.270904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.271679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.272314 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.286810 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] HTTP exception thrown: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Request method failure captured: May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 HTTP/1.1 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1CQD7LZ5g1PBft6vBIt-hDNZud8QI2d1roKBwAzzq9He7dokxD9IIzhRoB8bHPOe_vrWZgypg428e0o6eqgq5M_EhLh_VbbRNSYgBMDpdjj7pOTXLRiMK5v5eWfNtzL4quUTXQ9rge-aznbY-ARL7hPPipqdHRznRb5VHtZmQAbRVs May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 4285af910bec40c4a5a5691d5492f941 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:02:32.288724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4285af910bec40c4a5a5691d5492f941"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4285af910bec40c4a5a5691d5492f941"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4285af910bec40c4a5a5691d5492f941"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4285af910bec40c4a5a5691d5492f941"}]}] May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 4285af910bec40c4a5a5691d5492f941 May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1346870818 May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-TestMinimumBasicScenario-1346870818-project May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 9f19dad38bba4adb9267a1fcbc26d7b2 May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-TestMinimumBasicScenario-1346870818-project May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. May 11 06:02:32.290292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '062320bf-1043-4042-8c15-82cfd3b16686'} May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:02:32.291119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. May 11 06:02:32.292457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:32.295385 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Returning 404 to user: Instance 062320bf-1043-4042-8c15-82cfd3b16686 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:02:32.296459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-180f545c-e127-44c9-83d8-18580a0a5111 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686" status: 404 len: 111 microversion: 2.1 time: 0.038666 May 11 06:02:32.301042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 365/713] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:32 2022] GET /compute/v2.1/servers/062320bf-1043-4042-8c15-82cfd3b16686 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:02:32.306244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ef4480ff-b250-4d42-96f0-f24c77054dd2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] Calling method '.version_select at 0x7fa1400e6c10>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:32.326394 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ef4480ff-b250-4d42-96f0-f24c77054dd2 tempest-TestMinimumBasicScenario-1346870818 tempest-TestMinimumBasicScenario-1346870818-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1693681529" status: 202 len: 0 microversion: 2.1 time: 0.023251 May 11 06:02:32.327203 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 366/714] 10.222.0.44 () {58 vars in 1271 bytes} [Wed May 11 06:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1693681529 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:02:32.386783 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:32.396913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0089a376-25fa-4bbf-ab4d-752921e6452a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.271362 May 11 06:02:32.397821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 349/715] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:32 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:32.412574 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:32.413190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:32.419878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.420553 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.421371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:32.421842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:32.487687 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:32.495473 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5f75d4e6-3a3b-44bc-a51e-dbf470b4926f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1203 microversion: 2.1 time: 0.086895 May 11 06:02:32.496249 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 367/716] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:32 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1203 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:33.414423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:33.415046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:33.426442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:33.427193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:33.428155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:33.428752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:33.515143 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:33.516856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:33.525891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:33.526347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:33.527132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:33.529575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:33.641554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:33.655268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9dd60273-9d22-4b0a-814b-8dfba72b00b3 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.244725 May 11 06:02:33.658255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 350/717] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:33 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:33.677532 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-97260745-302d-407c-9255-31d459c157b8 req-cd4cc87c-b105-4704-aa2e-36d9eb933e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:33.689438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-97260745-302d-407c-9255-31d459c157b8 req-cd4cc87c-b105-4704-aa2e-36d9eb933e0e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:33.690384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-97260745-302d-407c-9255-31d459c157b8 req-cd4cc87c-b105-4704-aa2e-36d9eb933e0e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:33.706237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-97260745-302d-407c-9255-31d459c157b8 req-cd4cc87c-b105-4704-aa2e-36d9eb933e0e service nova] Creating event network-changed:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:02:33.712163 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-97260745-302d-407c-9255-31d459c157b8 req-cd4cc87c-b105-4704-aa2e-36d9eb933e0e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043346 May 11 06:02:33.713049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 351/718] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:33.766929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:33.774605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2510bb97-02b1-4524-9bc5-324704c93f38 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.265305 May 11 06:02:33.785560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 368/719] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:33 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:34.072699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:34.073614 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:34.080566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.081610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.082601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.083205 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.111009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:02:34.211630 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cb5a9b5c-0926-4901-a645-6b8d6c23334d tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 204 len: 0 microversion: 2.1 time: 0.143904 May 11 06:02:34.212219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 352/720] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:02:34 2022] DELETE /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:02:34.221435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:34.222074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:34.232338 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.233053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.233879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.234313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.459016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:34.467118 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a3a4cd52-4bf5-4609-83d9-87c2022cc09e tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1514 microversion: 2.1 time: 0.249716 May 11 06:02:34.467773 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 369/721] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:34 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:34.676508 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:34.677196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:34.683368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.683812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.684639 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.685270 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.792114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:34.792802 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:34.799995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.800774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.801692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:34.802329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:34.834082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:34.841885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-30e7699b-b3f3-4e29-9e77-38905c219d34 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.169561 May 11 06:02:34.851474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 353/722] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:34 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:35.003321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:35.011346 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e27e8c29-4360-435b-bf8e-c9bc454ba82a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.223142 May 11 06:02:35.011933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 370/723] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:34 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:35.484921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:35.485575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:35.491402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:35.491852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:35.492627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:35.493063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:35.648268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:35.659644 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0cad3ecf-f256-4e6c-b097-8bad26f2f25a tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1514 microversion: 2.1 time: 0.179166 May 11 06:02:35.665856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 354/724] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:35 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:35.859834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:35.860443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:35.866675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:35.867120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:35.867915 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:35.868329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:36.031025 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:36.031747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:36.038514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:36.038955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:36.039729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:36.040161 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:36.088451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:36.099055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7fcaadf6-3b18-4f30-ad52-f725ef76c835 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.243873 May 11 06:02:36.100318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 371/725] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:35 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:36.232892 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:36.242791 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a1bda3ad-c3e9-4471-9532-b99bbf3130c2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.216875 May 11 06:02:36.243410 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 355/726] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:36 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:36.677070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:36.677761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:36.684099 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:36.685297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:36.686309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:36.686900 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.042968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:37.064668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4b0cb62a-93f0-4415-bb93-cbcc4d01f3c8 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1514 microversion: 2.1 time: 0.389170 May 11 06:02:37.064668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 372/727] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:36 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:37.116661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:37.117959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:37.124512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:37.124965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.125770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:37.126380 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.262804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:37.262804 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:37.268936 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:37.269488 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.270194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:37.273912 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.324545 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:37.335219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-42039266-51a8-4bad-8027-ca802ff2e348 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.221859 May 11 06:02:37.335344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 356/728] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:37 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:37.494734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-622f7b39-7d04-48f8-8a8d-ed6205369901 req-4d2a8812-6fa0-463b-bb16-4daec2076cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c823e6a3-6d8d-4ab2-868a-d85eed39ced1", "name": "network-vif-deleted", "tag": "8bd90930-e072-4204-8f1a-43b6651cec1e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:37.508471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-622f7b39-7d04-48f8-8a8d-ed6205369901 req-4d2a8812-6fa0-463b-bb16-4daec2076cff service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:37.509118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-622f7b39-7d04-48f8-8a8d-ed6205369901 req-4d2a8812-6fa0-463b-bb16-4daec2076cff service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:37.525453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-622f7b39-7d04-48f8-8a8d-ed6205369901 req-4d2a8812-6fa0-463b-bb16-4daec2076cff service nova] Creating event network-vif-deleted:8bd90930-e072-4204-8f1a-43b6651cec1e for instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 on hv-cinder-73362 May 11 06:02:37.531911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-622f7b39-7d04-48f8-8a8d-ed6205369901 req-4d2a8812-6fa0-463b-bb16-4daec2076cff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040779 May 11 06:02:37.533635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 357/729] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:02:37.550617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:37.558220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d6eb186b-0e45-46e8-b0c6-b131831b7e10 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.301670 May 11 06:02:37.569082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 373/730] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:37 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:38.079954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:38.080876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:38.087214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.087754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.088640 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.089308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.128067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.128729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.128968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lazy-loading 'fault' on Instance uuid c823e6a3-6d8d-4ab2-868a-d85eed39ced1 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:38.188088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c054038efc2741ba951666abb68e1cf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a889575293f48af826e9734868e2714', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:38.196154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e86b598f-6eb5-413e-ad4d-951956864102 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 200 len: 1309 microversion: 2.1 time: 0.120264 May 11 06:02:38.196929 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 358/731] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:38 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:38.352476 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:38.353098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:38.359582 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.360044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.360832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.361276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.495728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:38.505230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-eed5f8aa-17df-4ee6-968e-e276e0e6b0cb tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.157007 May 11 06:02:38.505924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 374/732] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:38 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:38.576451 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:38.577221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:38.583414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.584012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.584908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:38.585453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:38.780158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:38.787474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-27d5a6d5-213e-417e-818b-8439cbdb66b4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.215223 May 11 06:02:38.788041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 359/733] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:38 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:39.217840 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:39.218699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] [instance: c823e6a3-6d8d-4ab2-868a-d85eed39ced1] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:39.224576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.225032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:39.225832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.226266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:39.239994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] HTTP exception thrown: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Request method failure captured: May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 HTTP/1.1 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1DQehkcTLKz8aQZiKKC_pOhqfbm5NAiVEgfU8IymMKq87xwnpEyuCKlHTEh5inltTG7qqXDIlJGNQDLNJFavM-b66RF97JmrnodU1_2RKj2dGzsLi2aV_hHwJwzbMGjl5Bz3sqGHLlP__6A2ajiK7oCGLbmk99cXEnjgG3IcpIX8ik May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 3a889575293f48af826e9734868e2714 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:02:39.241501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3a889575293f48af826e9734868e2714"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3a889575293f48af826e9734868e2714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a889575293f48af826e9734868e2714"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3a889575293f48af826e9734868e2714"}]}] May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 3a889575293f48af826e9734868e2714 May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1056106872 May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesSnapshotTestJSON-1056106872-project May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: c054038efc2741ba951666abb68e1cf7 May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesSnapshotTestJSON-1056106872-project May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. May 11 06:02:39.242855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'c823e6a3-6d8d-4ab2-868a-d85eed39ced1'} May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:02:39.243576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. May 11 06:02:39.244742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:39.245883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] Returning 404 to user: Instance c823e6a3-6d8d-4ab2-868a-d85eed39ced1 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:02:39.245883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-484da736-47e8-45a2-abd6-20574c5b19f4 tempest-VolumesSnapshotTestJSON-1056106872 tempest-VolumesSnapshotTestJSON-1056106872-project] 10.222.0.44 "GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1" status: 404 len: 111 microversion: 2.1 time: 0.031232 May 11 06:02:39.245883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 375/734] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:39 2022] GET /compute/v2.1/servers/c823e6a3-6d8d-4ab2-868a-d85eed39ced1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:02:39.523651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:39.525032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:39.536408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.536860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:39.537675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.550209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:39.722112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:39.730455 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-486c2a28-56a4-4805-bb1f-5d3e594578ac tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.211309 May 11 06:02:39.731048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 360/735] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:39 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:39.806191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:39.807307 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:39.815429 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.815553 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:39.816330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:39.816769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:40.072451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:40.081964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-39e8ef22-1dfc-4a69-9d85-0b7135f5aef7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.280705 May 11 06:02:40.082543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 376/736] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:39 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:40.750315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:40.750796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:40.765512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:40.766295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:40.767224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:40.767641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:41.024125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:41.032772 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-982cfde8-aebc-488d-9105-0c3110d9af42 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.288575 May 11 06:02:41.033649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 361/737] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:40 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:41.098898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:41.099550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:41.107726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:41.108290 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:41.109100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:41.109572 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:41.245363 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:41.252959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2c8ab952-1ac2-449e-9b20-38752882ff5c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.157902 May 11 06:02:41.262122 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 377/738] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:41 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:42.050810 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:42.051516 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:42.057886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:42.058340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:42.059109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:42.059652 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:42.193765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:42.202386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b258855b-ae66-44b0-8e4d-c40b1df3153a tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.155439 May 11 06:02:42.202964 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 362/739] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:42 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:42.270349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:42.271031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:42.278148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:42.278776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:42.279579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:42.280021 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:42.425267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:42.433082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4a154d75-6957-47a9-820d-626224fa0235 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.166952 May 11 06:02:42.433701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 378/740] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:42 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:43.221221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:43.221878 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:43.228198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:43.228648 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:43.229449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:43.229914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:43.362301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:43.370070 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e89d10f0-600e-4446-9d5e-e374bf770f16 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1734 microversion: 2.1 time: 0.152825 May 11 06:02:43.370682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 363/741] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:43 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:43.450992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:43.451523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:43.457793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:43.458244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:43.459004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:43.459436 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:43.587023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:43.594841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dae26abd-a1c6-4588-806c-d0ac3a234725 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.148330 May 11 06:02:43.595416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 379/742] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:43 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:44.126342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.126845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.132955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.133405 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.134195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.134625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.163044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4c7fb464-6db7-4788-9847-11ba2c52f271 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments/04dbecaf-535a-4a5e-af97-f95fb4a38047" status: 200 len: 194 microversion: 2.20 time: 0.041533 May 11 06:02:44.163623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 364/743] 10.222.0.44 () {60 vars in 1453 bytes} [Wed May 11 06:02:44 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments/04dbecaf-535a-4a5e-af97-f95fb4a38047 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:02:44.227086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.227583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.234321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.234778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.235546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.235987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.314467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lazy-loading 'services' on Instance uuid 276af0f1-c869-454b-ae66-454979121c15 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:44.383448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-aa2c41e3-04aa-4496-97af-b70d80af703d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments/04dbecaf-535a-4a5e-af97-f95fb4a38047" status: 202 len: 0 microversion: 2.20 time: 0.160056 May 11 06:02:44.384033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 380/744] 10.222.0.44 () {60 vars in 1456 bytes} [Wed May 11 06:02:44 2022] DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments/04dbecaf-535a-4a5e-af97-f95fb4a38047 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:02:44.386493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.387108 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.392997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.393943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.394157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.394393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.395168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.395606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.400156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.400606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.401561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.402157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.432666 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7d987aef-c0f3-47b4-8baa-24bba35d3e3e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044069 May 11 06:02:44.433245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 381/745] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 06:02:44 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:02:44.524097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:44.532636 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-44052689-3e23-4ebc-9ed1-806ba6870fe5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1714 microversion: 2.1 time: 0.150103 May 11 06:02:44.533210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 365/746] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:44 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:44.611852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.613004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.619327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.619779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.620539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.620974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.632964 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.633463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.639323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.639951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.641166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.641627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.720483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] HTTP exception thrown: Cannot 'detach_volume' instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 while it is in vm_state rescued May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Request method failure captured: May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments/535edb90-ef57-41c6-ba4b-9d3ee628bc5c HTTP/1.1 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B21o_mpixF3E4vzUVPu6SH0Cex_RVyY9WP2Vv_dzgqFim6zWZ62yKSyx-LSyOczH5Aslqn5zoGxK946bIE9W5sCJvgPEY88T--15dCfBiVlrjuKSEW5VxEmCiUoTChZpnKojdkjPg7ejMdmvgG2GWVIJjr8Jt9AOF9rBHp10j8Zu0 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:02:44.722607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}] May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 28c76d12b0b1436d8eb0b23acf252f25 May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:02:44.724246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Cannot 'detach_volume' instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 while it is in vm_state rescued May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'server_id': '7ba0054f-a786-4f8b-b701-cebccd1c7fc2', 'id': '535edb90-ef57-41c6-ba4b-9d3ee628bc5c'} May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:02:44.725083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 while it is in vm_state rescued May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 while it is in vm_state rescued May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:02:44.726493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Returning 409 to user: Cannot 'detach_volume' instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 while it is in vm_state rescued {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:02:44.727584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4df517c6-4bfc-4182-9d5c-e6847ae89195 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments/535edb90-ef57-41c6-ba4b-9d3ee628bc5c" status: 409 len: 152 microversion: 2.1 time: 0.096351 May 11 06:02:44.727584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 366/747] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:02:44 2022] DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments/535edb90-ef57-41c6-ba4b-9d3ee628bc5c => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 06:02:44.735192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:44.735724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.742342 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.742803 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.743580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.744023 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.758827 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:44.766666 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a516b7c4-715c-480b-9b40-58257dc8a63e tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.158594 May 11 06:02:44.767316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 382/748] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:44 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:44.809037 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-29426e40-37db-495f-b010-3dd6dca6dbc4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/action" status: 202 len: 0 microversion: 2.1 time: 0.077909 May 11 06:02:44.809966 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 367/749] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:02:44 2022] POST /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:02:44.817954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:44.818561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:44.824396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.824909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.825918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:44.826355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:44.950713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:44.958626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-96036c5f-69e6-4d29-baf9-548ddcc57261 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.144486 May 11 06:02:44.959201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 383/750] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:44 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:45.446436 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:45.447535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:45.454742 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.455183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:45.455936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:45.484038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a986b688-e5d9-4217-86be-ad516fac0e9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042046 May 11 06:02:45.484572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 368/751] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 06:02:45 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:02:45.784261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:45.784950 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:45.791498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.791951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:45.792737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.793168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:45.976323 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:45.977207 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:45.983487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.984279 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:45.985305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:45.985985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.006559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:46.017610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c4711357-c87a-4fd7-a5cf-0e9b2618b2ca tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.237080 May 11 06:02:46.018887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 384/752] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:45 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:46.120118 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:46.129654 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e6c6014f-8637-4574-9aeb-55d4fbd3c2b9 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.157295 May 11 06:02:46.130229 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 369/753] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:45 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:46.497418 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:46.498872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:46.504848 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.505628 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.506571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.507008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.535478 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ece36261-489d-4de4-8863-fba8437a6d96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042996 May 11 06:02:46.536043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 385/754] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 06:02:46 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:46.593865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:46.594438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:46.600757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.601282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.602165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.602674 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.628897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:02:46.707934 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-176c9e3c-a484-41f7-b877-4c0d295ec90a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 204 len: 0 microversion: 2.20 time: 0.117731 May 11 06:02:46.708439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 370/755] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 06:02:46 2022] DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 06:02:46.717693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:46.718303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:46.724087 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.724538 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.725302 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:46.725899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:46.856717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:46.864759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:46.866307 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:46.867603 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-23f09f85-d72d-49d1-b9db-5c16ea4db465 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.154886 May 11 06:02:46.868191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 386/756] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:46 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:47.035685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:47.036390 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:47.042333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.042782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:47.044196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.044638 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:47.147797 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:47.148415 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:47.154951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.155409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:47.156188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.156631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:47.177381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:47.185269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b90d09ef-bb8a-4105-b216-8560d47e34dc tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.153714 May 11 06:02:47.194719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 371/757] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:47 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:47.440176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:47.448575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-cff52ab0-148f-44f4-a555-7b4373457ee2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.304445 May 11 06:02:47.449150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 387/758] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:47 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:47.885910 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:47.886525 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:47.893540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.893996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:47.894766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:47.895202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.001760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-0fd03097-30c5-4bd3-b12d-1f7d4315731e req-7a8deffa-ad63-4982-8889-9cc092bbc50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "name": "network-vif-plugged", "status": "completed", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:48.011953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0fd03097-30c5-4bd3-b12d-1f7d4315731e req-7a8deffa-ad63-4982-8889-9cc092bbc50d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:48.013212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0fd03097-30c5-4bd3-b12d-1f7d4315731e req-7a8deffa-ad63-4982-8889-9cc092bbc50d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.025969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-0fd03097-30c5-4bd3-b12d-1f7d4315731e req-7a8deffa-ad63-4982-8889-9cc092bbc50d service nova] Creating event network-vif-plugged:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:02:48.031533 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-0fd03097-30c5-4bd3-b12d-1f7d4315731e req-7a8deffa-ad63-4982-8889-9cc092bbc50d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034905 May 11 06:02:48.032139 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 388/759] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:02:48.033235 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:48.041127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:48.042770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:48.044521 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f3079a3c-278b-4425-bc27-53c6bfcab728 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.162525 May 11 06:02:48.045146 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 372/760] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:47 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:48.202626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:48.203335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:48.209565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:48.210024 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.210802 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:48.211247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.344370 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:48.351852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a49d65da-bc1e-4388-924b-f25764a25ada tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.153442 May 11 06:02:48.352426 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 389/761] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:48 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:48.467013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:48.467549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:48.473609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:48.474063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.474829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:48.475264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:48.599428 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:48.607897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-15de5f73-01dd-43a5-a70b-5a790df09145 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.145266 May 11 06:02:48.608460 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 373/762] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:48 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:49.062511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:49.063064 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:49.069502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.069959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.070723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.071154 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.200441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:49.208344 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:49.209874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:49.211023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-deddf089-b4ca-44ea-ae04-b228b06b7ec9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.153114 May 11 06:02:49.211584 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 390/763] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:49 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:49.369140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:49.369792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:49.376804 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.377251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.378041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.378478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.560886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:49.568115 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7345134d-7bc4-4b9c-b035-675faf7e5c9c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.202864 May 11 06:02:49.568672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 374/764] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:49 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:49.625494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:49.626026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:49.632040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.632497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.633273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:49.633739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:49.760040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:49.768417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-73e6aeef-bb6d-4ff3-9c68-823fa495165d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.147470 May 11 06:02:49.768990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 391/765] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:49 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:50.229300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:50.229932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:50.236171 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.236535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.237293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.237757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.362045 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:50.369690 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:50.371304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:50.372610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0074bb2f-ad92-4fed-a504-f355618c65c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.147244 May 11 06:02:50.373157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 375/766] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:50 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:50.584588 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:50.585109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:50.591594 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.592044 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.592816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.593256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.720824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:50.728147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c54636c4-cf5d-402c-886b-831a3475c1e7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.147485 May 11 06:02:50.728728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 392/767] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:50 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:50.786093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:50.786705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:50.792935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.794124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.795068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:50.795621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:50.927736 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:50.935752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e3b4b10e-191c-4881-9a0a-fda41a9a65ef tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.153675 May 11 06:02:50.936319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 376/768] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:50 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:51.391546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:51.392170 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:51.398130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.398590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:51.399361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.399807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:51.524526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:51.534162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:51.536072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:51.537273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6719fd97-f3f8-46e4-bdb4-fdcfcbedcd72 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.150459 May 11 06:02:51.538146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 393/769] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:51 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:51.745377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:51.746015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:51.752542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.752984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:51.753764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.754196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:51.880876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:51.888264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2435e090-27ac-4af7-8bbd-bd758ce395c6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.146736 May 11 06:02:51.888818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 377/770] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:51 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:51.952960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:51.953615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:51.959957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.960411 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:51.961188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:51.961662 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:52.090796 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:52.098456 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-49f1d9c9-2da8-492c-992e-8c557976beb2 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1722 microversion: 2.1 time: 0.149563 May 11 06:02:52.099018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 394/771] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:51 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:52.555363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:52.555975 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:52.562176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:52.562624 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:52.563388 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:52.563821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:52.700206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:52.708061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:52.709572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:52.710707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5c605ac0-e9bd-4355-b6de-4ff1b400f3b2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.159389 May 11 06:02:52.711261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 378/772] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:52 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:52.905293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:52.905851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:52.911630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:52.912163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:52.912842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:52.913273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.040865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:53.048083 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3d980d8d-7339-4739-b63b-e6afb12ec586 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.146844 May 11 06:02:53.048656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 395/773] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:52 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:53.116005 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:53.116625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:53.124422 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.124876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.125682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.126120 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.257099 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:53.266221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bcf8e8e3-8607-4755-ac89-9246c69a8d4b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1728 microversion: 2.1 time: 0.153411 May 11 06:02:53.266911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 379/774] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:53 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:53.283756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:53.284259 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:53.290537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.290998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.291774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.292210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.380288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-943a7ab9-ad06-48af-8738-ed4300f226c7 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100682 May 11 06:02:53.385522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 396/775] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:02:53 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:53.729376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:53.732346 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:53.738311 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.738757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:53.739641 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:53.739953 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:54.065173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:54.065854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:54.071646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:54.072126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:54.072892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:54.073329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:54.105183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:54.113774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:54.115651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:54.117038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-15d8d17c-ff8b-4c0e-96da-463bcdb4118f tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1724 microversion: 2.20 time: 0.391609 May 11 06:02:54.118232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 380/776] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:53 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1724 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:54.243994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:54.252631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ba40082f-689b-4be4-800a-e3bc25053a42 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.191669 May 11 06:02:54.253335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 397/777] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:54 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:02:55.136245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:55.136870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:55.143449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:55.143902 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:55.144667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:55.145103 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:55.253637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:55.269782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:55.270400 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:55.288788 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:55.290333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:55.291498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ceac79a8-c6c7-4e8e-a194-6ef2e9a7fb00 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1657 microversion: 2.20 time: 0.159319 May 11 06:02:55.292563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 381/778] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:55 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:55.294550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:55.295162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:55.295966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:55.296413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:55.461568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-9c617c6b-86c4-4323-b885-304d8bf3847c req-07bcdb3c-d71c-4f32-a41c-4022556d1ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:55.474837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-9c617c6b-86c4-4323-b885-304d8bf3847c req-07bcdb3c-d71c-4f32-a41c-4022556d1ee4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:55.476695 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-9c617c6b-86c4-4323-b885-304d8bf3847c req-07bcdb3c-d71c-4f32-a41c-4022556d1ee4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:55.500456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-9c617c6b-86c4-4323-b885-304d8bf3847c req-07bcdb3c-d71c-4f32-a41c-4022556d1ee4 service nova] Creating event network-changed:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:02:55.514272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-9c617c6b-86c4-4323-b885-304d8bf3847c req-07bcdb3c-d71c-4f32-a41c-4022556d1ee4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056295 May 11 06:02:55.515195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 382/779] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:02:55.525319 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:55.533567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7fc50eac-b8e3-4592-8af0-122050d19365 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1259 microversion: 2.1 time: 0.267917 May 11 06:02:55.534525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 398/780] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:55 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:56.315267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:56.316338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:56.323465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.323913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.324918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.325341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.359386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.360045 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.360661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lazy-loading 'fault' on Instance uuid 276af0f1-c869-454b-ae66-454979121c15 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:02:56.411031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:56.421217 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:56.423063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:56.424735 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-30d5e4b0-6f9f-4c03-af65-1fba55d758c8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 200 len: 1371 microversion: 2.20 time: 0.116219 May 11 06:02:56.425313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 383/781] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:56 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:02:56.551075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:56.551774 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:56.558200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.558664 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.559442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.559880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.699939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:56.714465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8da5c32d-68ac-48ba-849d-44e5f4f89c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1443 microversion: 2.1 time: 0.167927 May 11 06:02:56.716364 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 399/782] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:56 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:56.733672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:56.735488 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:56.747870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.748676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.749586 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:56.750236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:56.983421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:02:56.990675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1c4f6673-cf11-4b22-8d37-3c73814b6981 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1443 microversion: 2.1 time: 0.261510 May 11 06:02:56.991240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 384/783] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:02:56 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1443 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:02:57.529673 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276af0f1-c869-454b-ae66-454979121c15", "name": "network-vif-deleted", "tag": "33ce7232-67e0-4db0-b8ff-2e2bcfc690b1"}, {"name": "network-changed", "server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:57.539535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:57.539976 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:57.552666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] Creating event network-vif-deleted:33ce7232-67e0-4db0-b8ff-2e2bcfc690b1 for instance 276af0f1-c869-454b-ae66-454979121c15 on hv-cinder-73362 May 11 06:02:57.553183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] Creating event network-changed:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:02:57.556196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:57.557380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:02:57.564052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-d3902eff-cdb7-4097-a253-e3d6ec2ae74d req-7595ef11-ced2-4434-aa74-c92d01ec5604 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034450 May 11 06:02:57.564711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 385/784] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) May 11 06:02:57.568986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:57.569728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:57.570875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:57.571409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:57.586600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 HTTP/1.1 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:02:57.588270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:02:57.590135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '276af0f1-c869-454b-ae66-454979121c15'} May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:02:57.591115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:02:57.592599 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:02:57.593949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:02:57.593949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7d7184ef-dadc-4a14-814c-cc3218b6db82 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 404 len: 111 microversion: 2.20 time: 0.149494 May 11 06:02:57.593949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 400/785] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:02:57 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:02:57.599500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b54377fa-3a7b-4328-b67b-491aeb02f93e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '.version_select at 0x7fa13ae1d280>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:02:57.617457 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b54377fa-3a7b-4328-b67b-491aeb02f93e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-380720542" status: 204 len: 0 microversion: 2.20 time: 0.022074 May 11 06:02:57.618758 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 386/786] 10.222.0.44 () {60 vars in 1258 bytes} [Wed May 11 06:02:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-380720542 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:02:58.669149 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-eb1ea259-5790-41e8-94a5-e3874103ce0a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: .version_select at 0x7fa1440e8ca0>, body: {"keypair": {"name": "tempest-keypair-1623292215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Aoj6iQUrrusSifvkgYeC1KbT3pa3KwyrUeZhVaHxPGcCpI+kJBCteEnuXLimBA8GYGHYfjdhSgIuiwS/jmuw6R4OfrXouGa40oAXB5iNU5sST1C9xZfgmtzXNxfryyg=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:58.687539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-eb1ea259-5790-41e8-94a5-e3874103ce0a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:02:58.691619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-eb1ea259-5790-41e8-94a5-e3874103ce0a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for user 8396cfed6d904f859ade91e210c619b5 and project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:02:58.713956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-eb1ea259-5790-41e8-94a5-e3874103ce0a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049625 May 11 06:02:58.714556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 401/787] 10.222.0.44 () {62 vars in 1199 bytes} [Wed May 11 06:02:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 06:02:58.807572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-3dae5f79-c229-4388-a4fe-c63294f32692 req-001bf5dc-54b4-406d-9200-65d64e58205e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:02:58.821766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-3dae5f79-c229-4388-a4fe-c63294f32692 req-001bf5dc-54b4-406d-9200-65d64e58205e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:02:58.822886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-3dae5f79-c229-4388-a4fe-c63294f32692 req-001bf5dc-54b4-406d-9200-65d64e58205e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:02:58.837214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-3dae5f79-c229-4388-a4fe-c63294f32692 req-001bf5dc-54b4-406d-9200-65d64e58205e service nova] Creating event network-changed:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:02:58.844267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-3dae5f79-c229-4388-a4fe-c63294f32692 req-001bf5dc-54b4-406d-9200-65d64e58205e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041161 May 11 06:02:58.845333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 387/788] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:03:00.457486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-924125502", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eec2f2f0-8c81-41fb-84f6-0e8c08e134ad"}], "security_groups": [{"name": "tempest-securitygroup--1281687192"}], "key_name": "tempest-keypair-1623292215", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:00.556683 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] validate_networks() for [('eec2f2f0-8c81-41fb-84f6-0e8c08e134ad', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:03:00.927568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:03:00.927998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:03:00.928480 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:03:00.928894 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:03:00.929340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:03:00.939359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:00.939833 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:00.940742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:00.941317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:00.957849 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:00.961797 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Getting quotas for user 8396cfed6d904f859ade91e210c619b5 and project 1f4f0f35ae0b4c94977f2e1688dbdb5c. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:00.973723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:03:00.975982 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:03:01.020540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7efe34de-0c05-4a82-9ba6-68638f6c9331 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.567533 May 11 06:03:01.021194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 402/789] 10.222.0.44 () {62 vars in 1187 bytes} [Wed May 11 06:03:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 06:03:01.032775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:01.033492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:01.086958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:01.094856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:01.096477 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:01.097817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-58d49703-3a5f-40b7-9e90-8b78b7c977f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1281 microversion: 2.20 time: 0.070201 May 11 06:03:01.098463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 388/790] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:01 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:02.117074 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:02.117737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:02.124866 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:02.125327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:02.126132 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:02.126605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:02.192316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:02.200250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:02.201792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:02.202960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5c4d87d2-384b-49fd-9094-5f8c8fee6085 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1333 microversion: 2.20 time: 0.090399 May 11 06:03:02.203515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 403/791] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:02 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:03.222464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:03.223945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:03.236938 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:03.237391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:03.240348 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:03.240808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:03.498355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:03.506972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:03.509568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:03.510815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9de41cdb-5d9f-4e15-b591-2f2c3b6109d7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.292243 May 11 06:03:03.511464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 389/792] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:03 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:04.111618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-7ed34524-9e2f-47f3-a8b8-fa7385ecec50 req-f68905e8-cdcf-42e0-84d7-a0a45de35c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:04.122218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-7ed34524-9e2f-47f3-a8b8-fa7385ecec50 req-f68905e8-cdcf-42e0-84d7-a0a45de35c4e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:04.122862 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-7ed34524-9e2f-47f3-a8b8-fa7385ecec50 req-f68905e8-cdcf-42e0-84d7-a0a45de35c4e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:04.139618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-7ed34524-9e2f-47f3-a8b8-fa7385ecec50 req-f68905e8-cdcf-42e0-84d7-a0a45de35c4e service nova] Creating event network-changed:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:03:04.145782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-7ed34524-9e2f-47f3-a8b8-fa7385ecec50 req-f68905e8-cdcf-42e0-84d7-a0a45de35c4e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039906 May 11 06:03:04.146738 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 404/793] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:04.530476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:04.531213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:04.537584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:04.538033 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:04.538940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:04.539373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:04.670901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:04.678655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:04.680142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:04.681242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cc45ccdf-84e0-49e0-b2a4-19891cbdedec tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.155968 May 11 06:03:04.681908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 390/794] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:04 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:05.699532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:05.700216 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:05.706865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:05.707701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:05.708485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:05.708925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:05.838095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:05.847225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:05.848741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:05.849890 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5d76d599-a47f-4a2d-ae0e-2d2946c04a15 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.154598 May 11 06:03:05.850460 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 405/795] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:05 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:06.868213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:06.868768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:06.875790 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:06.876237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:06.876999 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:06.877437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:07.005165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:07.012868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:07.014387 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:07.015527 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6efaa906-2b46-41a9-9a67-b64bb3da6258 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.151322 May 11 06:03:07.016352 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 391/796] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:06 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:08.033999 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:08.035227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:08.042151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:08.042919 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:08.043891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:08.044454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:08.045312 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-a78759fe-86fe-4860-bb22-91e992c45d24 req-289c7f60-42f4-436a-a788-4f6a4e8901a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "name": "network-vif-plugged", "status": "completed", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:08.053627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a78759fe-86fe-4860-bb22-91e992c45d24 req-289c7f60-42f4-436a-a788-4f6a4e8901a1 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:08.054078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a78759fe-86fe-4860-bb22-91e992c45d24 req-289c7f60-42f4-436a-a788-4f6a4e8901a1 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:08.065837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-a78759fe-86fe-4860-bb22-91e992c45d24 req-289c7f60-42f4-436a-a788-4f6a4e8901a1 service nova] Creating event network-vif-plugged:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:03:08.070996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-a78759fe-86fe-4860-bb22-91e992c45d24 req-289c7f60-42f4-436a-a788-4f6a4e8901a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029891 May 11 06:03:08.071696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 392/797] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:08.180651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:08.191608 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:08.193153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:08.194292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bee93f1a-2f88-49fe-bb5b-7f2dabf9b573 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.164638 May 11 06:03:08.194889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 406/798] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:08 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:09.213117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:09.213829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:09.220891 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:09.221335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:09.222121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:09.222554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:09.352679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:09.360663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:09.362188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:09.363275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1672a596-3769-4338-a6e3-6bd29e652127 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1407 microversion: 2.20 time: 0.154836 May 11 06:03:09.363880 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 393/799] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:09 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:10.381972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:10.382581 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:10.388984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:10.389454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:10.390242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:10.390934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:10.517945 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:10.525903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:10.528155 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:10.529311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c732d18e-e23e-472e-878b-b3591ed93e92 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1600 microversion: 2.20 time: 0.151463 May 11 06:03:10.529948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 407/800] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:03:10 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:03:10.546297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:10.546796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:10.553116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:10.553606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:10.554374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:10.554814 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:10.629107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a0036736-4ad9-4b52-a27b-2237be1cc9c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.086737 May 11 06:03:10.629752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 394/801] 10.222.0.44 () {60 vars in 1315 bytes} [Wed May 11 06:03:10 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:03:11.588190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-d6f268b5-44fe-4bcf-8255-a5345dd676aa req-ec7c6519-4727-4cf4-9d38-9c687adf12ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:11.597187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d6f268b5-44fe-4bcf-8255-a5345dd676aa req-ec7c6519-4727-4cf4-9d38-9c687adf12ce service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:11.597669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d6f268b5-44fe-4bcf-8255-a5345dd676aa req-ec7c6519-4727-4cf4-9d38-9c687adf12ce service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:11.608746 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-d6f268b5-44fe-4bcf-8255-a5345dd676aa req-ec7c6519-4727-4cf4-9d38-9c687adf12ce service nova] Creating event network-changed:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:03:11.613742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-d6f268b5-44fe-4bcf-8255-a5345dd676aa req-ec7c6519-4727-4cf4-9d38-9c687adf12ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029275 May 11 06:03:11.614560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 408/802] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:13.708899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:13.709409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:13.715356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:13.715802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:13.716553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:13.716981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:13.740197 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c17f0e16-22b6-4a30-b8c5-3b71afd7c717 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/ips" status: 200 len: 148 microversion: 2.1 time: 0.248185 May 11 06:03:13.740740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 395/803] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:03:13 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/ips => generated 148 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:14.933661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:14.934247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:14.941510 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:14.941901 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:14.942992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:14.943455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:14.967739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:15.044150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35f63258-2180-49b4-92ad-ccd36e694bdc"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:15.045836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:15.051373 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-35d7cdbe-cd8b-497b-9c63-80990a9801f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "DELETE /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 204 len: 0 microversion: 2.1 time: 0.122331 May 11 06:03:15.052384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:15.052534 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 409/804] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:14 2022] DELETE /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:03:15.052649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:15.053318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:15.053790 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:15.060448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:15.061820 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:15.067501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:15.067961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:15.068735 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:15.069176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:15.202946 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:15.210311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-dde60547-5909-4c3c-b5aa-515a30f29e36 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1577 microversion: 2.1 time: 0.153884 May 11 06:03:15.210886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 410/805] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:15 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:16.227913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:16.228514 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:16.235742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:16.236191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:16.236963 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:16.237398 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:16.364515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:16.371798 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-68ff788c-c3a1-4b90-8476-078ed5090f7d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1577 microversion: 2.1 time: 0.147758 May 11 06:03:16.372376 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 411/806] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:16 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:16.843431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-88047a24-2156-4db8-84dc-e254e17cfa22 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.803118 May 11 06:03:16.844076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 396/807] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:03:15 2022] POST /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments => generated 194 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:03:17.388218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:17.390191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:17.395441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:17.395983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:17.396815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:17.397334 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:17.530857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:17.538451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-14cfb019-0207-477e-9cbc-e682f85787cb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1577 microversion: 2.1 time: 0.154171 May 11 06:03:17.539037 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 412/808] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:17 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:18.391042 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-d4ca79ad-0c8d-47c5-9831-2f088f618248 req-0b8338d1-c9f6-41f1-9f4d-73b64d124a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56072492-2dc2-4297-81ad-5f56dd97e54a", "name": "network-vif-deleted", "tag": "7bedeb63-cb08-4227-a110-028c3175d7d0"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:18.402117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d4ca79ad-0c8d-47c5-9831-2f088f618248 req-0b8338d1-c9f6-41f1-9f4d-73b64d124a1e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:18.402663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-d4ca79ad-0c8d-47c5-9831-2f088f618248 req-0b8338d1-c9f6-41f1-9f4d-73b64d124a1e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:18.414831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-d4ca79ad-0c8d-47c5-9831-2f088f618248 req-0b8338d1-c9f6-41f1-9f4d-73b64d124a1e service nova] Creating event network-vif-deleted:7bedeb63-cb08-4227-a110-028c3175d7d0 for instance 56072492-2dc2-4297-81ad-5f56dd97e54a on hv-cinder-73362 May 11 06:03:18.419765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-d4ca79ad-0c8d-47c5-9831-2f088f618248 req-0b8338d1-c9f6-41f1-9f4d-73b64d124a1e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 May 11 06:03:18.421277 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 397/809] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:18.556377 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:18.557003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:18.563855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:18.564306 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:18.565075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:18.565529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:18.626312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:18.633776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8cfe6f40-bcc5-4f2f-9fc9-ba9ec2f0eb60 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 200 len: 1225 microversion: 2.1 time: 0.081275 May 11 06:03:18.638104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 413/810] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:18 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:19.656627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:19.657247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:19.663851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:19.664297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:19.665067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:19.665528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:19.678932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] HTTP exception thrown: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Request method failure captured: May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a HTTP/1.1 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1C46m7QvIVDRHVF3nPG-nfVU1aQwxv3nVZIDtaEDq7JM0LtWRY0usuQELmt0V9y1oQbEx1351QwdWFFumOBhs9jgJIPWUPEZ0FfEMYN_GgKVUvfW8zHemilDQL5HqqU3xLdpwacAfvIKrbSKypCT8T73zy0_g3UdawPl3zkhtp9dfA May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:19.680513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}] May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-TestVolumeBootPattern-470242454 May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-TestVolumeBootPattern-470242454-project May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: bbc14e1f89334e65b24fec7b4a321c5d May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-TestVolumeBootPattern-470242454-project May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:03:19.682032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '56072492-2dc2-4297-81ad-5f56dd97e54a'} May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:19.682869 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:03:19.684661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:19.686216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Returning 404 to user: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:19.686216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-80a2445b-4255-4a5b-b49b-54d9c3f76744 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 404 len: 111 microversion: 2.1 time: 0.030317 May 11 06:03:19.686216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 398/811] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:19 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:03:19.774118 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-56878094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860430622", "security_groups": [{"name": "tempest-secgroup-smoke-1626878111"}], "block_device_mapping_v2": [{"uuid": "d7da24b9-012e-49be-a60d-999c5cf03a3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c2135e5-d24e-4b23-bdbc-168d1955897d"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:19.883355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] validate_networks() for [('1c2135e5-d24e-4b23-bdbc-168d1955897d', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:03:20.327020 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:03:20.327475 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:03:20.327894 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:03:20.328304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:03:20.328717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:03:20.337325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:20.337817 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:20.338627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:20.339068 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:20.355674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:20.359616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for user bbc14e1f89334e65b24fec7b4a321c5d and project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:20.414975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:03:20.417071 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d7da24b9-012e-49be-a60d-999c5cf03a3d',volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:03:20.539328 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-69af6dfd-fcb0-4801-bdc0-c33813ff6f48 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.769051 May 11 06:03:20.539986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 414/812] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:03:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:03:20.551033 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ea90e67f-53be-47d6-b231-8f5fa62834bb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:20.551684 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ea90e67f-53be-47d6-b231-8f5fa62834bb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:20.605432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ea90e67f-53be-47d6-b231-8f5fa62834bb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:20.613186 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ea90e67f-53be-47d6-b231-8f5fa62834bb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1092 microversion: 2.1 time: 0.065924 May 11 06:03:20.613783 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 399/813] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:20 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1092 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:21.226148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:21.227144 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:21.234250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.234671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.235445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.235886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.264302 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2e6fd1d5-31c0-49db-a8b6-a0700da7386d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042560 May 11 06:03:21.264865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 415/814] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:21 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:03:21.321694 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:21.322304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:21.328341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.328794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.329608 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.330083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.354467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:21.429061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5331eb08-eac0-43fd-95d5-656a59b6c495 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 204 len: 0 microversion: 2.1 time: 0.110865 May 11 06:03:21.429549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 400/815] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:21 2022] DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:03:21.437607 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:21.438223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:21.443966 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.444620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.445395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.445863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.580032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:21.587662 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d1eef1d6-c6f2-4cc1-bec2-b8d74a041d43 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1674 microversion: 2.1 time: 0.153855 May 11 06:03:21.588235 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 416/816] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:21 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:21.630051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:21.630832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:21.637657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.638142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.638921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:21.639362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:21.700335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:21.708344 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d54ee78c-fb24-4077-9049-87584b5b95c1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1198 microversion: 2.1 time: 0.082540 May 11 06:03:21.709102 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 401/817] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:21 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:22.605722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:22.606320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:22.613451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:22.613935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:22.614693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:22.615124 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:22.725312 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:22.726187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:22.732585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:22.733031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:22.734623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:22.735062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:22.745878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:22.753348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1f4a510a-d5b6-4120-a6c7-5122a2f1db30 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1674 microversion: 2.1 time: 0.151689 May 11 06:03:22.753947 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 417/818] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:22 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:22.799990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:22.807330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a3b983b8-d39e-4976-9c62-f8b1772ea953 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1198 microversion: 2.1 time: 0.085883 May 11 06:03:22.807886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 402/819] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:22 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:23.771254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:23.771909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:23.779112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:23.779568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:23.780481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:23.780934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:23.824826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:23.829112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:23.836887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:23.837509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:23.838381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:23.838988 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:23.916955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:23.917657 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:23.925278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-372547b1-fc64-49e8-ab4f-ccc95a3befc5 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1674 microversion: 2.1 time: 0.157820 May 11 06:03:23.925996 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fea52e0c-b8bc-4d0d-a503-4924b3a2d6e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1208 microversion: 2.1 time: 0.105639 May 11 06:03:23.933560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 418/820] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:23 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:23.933734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 403/821] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:23 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1208 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:24.943908 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:24.944558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:24.944991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:24.945459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:24.951796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:24.952370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:24.953403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:24.954097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:24.956541 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:24.957005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:24.958452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:24.959051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.066357 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:25.074353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1ec7c101-c12d-4b23-8674-ea09385364b7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1208 microversion: 2.1 time: 0.134409 May 11 06:03:25.075019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 419/822] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:24 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1208 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:25.164995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:25.174381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d05d79f9-4439-4ce9-90e3-d97ce1a44116 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1674 microversion: 2.1 time: 0.234606 May 11 06:03:25.174955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 404/823] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:24 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:25.428306 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35f63258-2180-49b4-92ad-ccd36e694bdc"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:25.430512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:25.437948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.438932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.439937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.440591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.558089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: POST /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments HTTP/1.1 May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 74 May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:03:25.560103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {"volumeAttachment": {"volumeId": "35f63258-2180-49b4-92ad-ccd36e694bdc"}} May 11 06:03:25.562308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'server_id': '4efab7ed-d556-45bf-b471-e4783656823e', 'body': {'volumeAttachment': {'volumeId': '35f63258-2180-49b4-92ad-ccd36e694bdc'}}} May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:03:25.563180 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:25.564354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:25.566721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:25.566721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:25.566721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:25.566721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e May 11 06:03:25.566721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:03:25.568157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 400 to user: Invalid volume: volume 35f63258-2180-49b4-92ad-ccd36e694bdc is already attached to instances: 4efab7ed-d556-45bf-b471-e4783656823e {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:25.569228 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6d55bc33-de7b-4393-85f3-f53964c32120 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145172 May 11 06:03:25.570056 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 420/824] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:03:25 2022] POST /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments => generated 174 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 06:03:25.700580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:25.701091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:25.715823 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.716411 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.717260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.718342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.727599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-0b151e23-3e5f-4401-a430-1fbdb6dfb79a req-caabd280-0b78-4227-8409-5b61127dcae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7c8f3d-2da4-4399-ac9d-42f991a37c96", "name": "network-vif-deleted", "tag": "2222d0f9-acf4-4372-9885-2ac3de9a79e8"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:25.748348 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0b151e23-3e5f-4401-a430-1fbdb6dfb79a req-caabd280-0b78-4227-8409-5b61127dcae3 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.749211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0b151e23-3e5f-4401-a430-1fbdb6dfb79a req-caabd280-0b78-4227-8409-5b61127dcae3 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.784212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-0b151e23-3e5f-4401-a430-1fbdb6dfb79a req-caabd280-0b78-4227-8409-5b61127dcae3 service nova] Creating event network-vif-deleted:2222d0f9-acf4-4372-9885-2ac3de9a79e8 for instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 on hv-cinder-73362 May 11 06:03:25.790816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-0b151e23-3e5f-4401-a430-1fbdb6dfb79a req-caabd280-0b78-4227-8409-5b61127dcae3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168485 May 11 06:03:25.797928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 405/825] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:25.861637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'services' on Instance uuid 4efab7ed-d556-45bf-b471-e4783656823e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:25.944076 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d46a88a2-f4ee-465f-a0a9-39c1158f7aa9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments/35f63258-2180-49b4-92ad-ccd36e694bdc" status: 202 len: 0 microversion: 2.1 time: 0.247330 May 11 06:03:25.944670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 421/826] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:03:25 2022] DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments/35f63258-2180-49b4-92ad-ccd36e694bdc => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:03:25.954687 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:25.955872 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:25.962699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.963145 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.963926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:25.964540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:25.996547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ba605d81-3c7b-427d-874b-79a11c4a9b02 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047379 May 11 06:03:25.997108 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 406/827] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:25 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:26.093827 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:26.094916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:26.103468 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.104179 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.105150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.105770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.194315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:26.194939 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:26.202300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.202748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.203604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.203998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.265416 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.266447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.267363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lazy-loading 'fault' on Instance uuid af7c8f3d-2da4-4399-ac9d-42f991a37c96 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:26.393210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:26.401674 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0faf648c-3add-4cff-8011-206bd5f8350d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 200 len: 1327 microversion: 2.1 time: 0.213238 May 11 06:03:26.402931 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 407/828] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:26 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 1327 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:26.424495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:26.441822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3d58bc32-1201-432d-941d-be4e23930378 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.352869 May 11 06:03:26.442840 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 422/829] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:26 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:26.482317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-4e295404-1fda-4057-ab48-56c01d26bba2 req-66242615-4284-4425-a23b-0b1e37d4d1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:26.491000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-4e295404-1fda-4057-ab48-56c01d26bba2 req-66242615-4284-4425-a23b-0b1e37d4d1c4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:26.491591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-4e295404-1fda-4057-ab48-56c01d26bba2 req-66242615-4284-4425-a23b-0b1e37d4d1c4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:26.504330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-4e295404-1fda-4057-ab48-56c01d26bba2 req-66242615-4284-4425-a23b-0b1e37d4d1c4 service nova] Creating event network-changed:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:03:26.510131 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-4e295404-1fda-4057-ab48-56c01d26bba2 req-66242615-4284-4425-a23b-0b1e37d4d1c4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105678 May 11 06:03:26.511031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 408/830] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:27.009634 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:27.011631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:27.019747 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.020207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.021004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.021457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.054687 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d6961f61-5daa-4021-be52-838fc3719e19 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049941 May 11 06:03:27.055504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 423/831] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:27 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:27.420701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:27.421543 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:27.427631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.428084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.428853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.429296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.442722 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 HTTP/1.1 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:27.444319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:03:27.445890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'af7c8f3d-2da4-4399-ac9d-42f991a37c96'} May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:27.446992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:03:27.448604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:27.450100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:27.450100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a6d61d00-ff5f-46af-afe3-e586ed119688 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 404 len: 111 microversion: 2.1 time: 0.029747 May 11 06:03:27.450100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 409/832] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:27 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:03:27.455817 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bfa97bd6-5adc-446f-8423-2ee7e52a70a0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '.version_select at 0x7fa144189ee0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:27.458753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:27.459552 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:27.465547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.466004 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.466777 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:27.467211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:27.473456 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bfa97bd6-5adc-446f-8423-2ee7e52a70a0 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178086888" status: 202 len: 0 microversion: 2.1 time: 0.022115 May 11 06:03:27.474148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 424/833] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 06:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178086888 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:03:27.714393 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:27.722054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f970d7cb-c085-44fa-8e41-f4953a5846b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.267034 May 11 06:03:27.722629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 410/834] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:27 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:28.066816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:28.068356 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:28.075192 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.075648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.076430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.076995 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.107586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8692e7c8-da7e-4e74-a96a-28875efa1e3e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044600 May 11 06:03:28.109033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 425/835] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:28 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:03:28.167211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:28.167760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:28.174939 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.175644 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.176567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.179301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.207984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:28.292972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-65665955-6b88-4558-9da2-96df31d6cd9b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: .version_select at 0x7fa1440e8790>, body: {"keypair": {"name": "tempest-keypair-1852646995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoKpTRVeQ17owHNFpGrNWMkeF4ZblYpviJPJg4qsSdWh0DZEVyfDCJ5hX/CtQSYxzLOsiSYjgaHQwshtXtDnSesNYbCwP7YAXA6ADSqdmUX0MVNmpCoFdaWSE9ZX58M0A=="}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:28.297563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a55732f4-5d0e-4e1c-b1a1-328afd83834e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 204 len: 0 microversion: 2.1 time: 0.133942 May 11 06:03:28.298140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 411/836] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:28 2022] DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:03:28.306519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:28.307236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:28.307940 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-65665955-6b88-4558-9da2-96df31d6cd9b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:28.311827 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-65665955-6b88-4558-9da2-96df31d6cd9b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for user aa2d83bcc02a43f89ba4785a9bdedd15 and project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'key_pairs'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:28.313456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.313932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.314705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.315142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.335428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-65665955-6b88-4558-9da2-96df31d6cd9b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047765 May 11 06:03:28.336043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 426/837] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 06:03:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:28.451359 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:28.460012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-48dcda89-070e-4088-85b0-df17f53782fe tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1680 microversion: 2.1 time: 0.157522 May 11 06:03:28.460587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 412/838] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:28 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:28.741452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:28.742173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:28.748035 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.748501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.749418 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:28.749902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:28.879826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:28.887095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-33c20673-2d3d-42cc-bb47-fa71293c510b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.150941 May 11 06:03:28.887663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 427/839] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:28 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:29.478678 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:29.479334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:29.486125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:29.486578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:29.487818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:29.488262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:29.556353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-955162444", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ac42e169-a6e4-4ccc-996b-bc8a23c39701"}], "security_groups": [{"name": "tempest-securitygroup--1957501454"}], "key_name": "tempest-keypair-1852646995", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:29.625901 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:29.634806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5fc9962e-505f-4171-bca5-e1e2788620a1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1680 microversion: 2.1 time: 0.159984 May 11 06:03:29.635473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 413/840] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:29 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:29.664871 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] validate_networks() for [('ac42e169-a6e4-4ccc-996b-bc8a23c39701', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:03:29.904274 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:29.904955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:29.910945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:29.911412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:29.912192 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:29.912635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:30.022968 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:03:30.023391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:03:30.023862 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:03:30.024270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:03:30.024706 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:03:30.033379 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:30.033856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:30.034660 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:30.035098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:30.047601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:30.051636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:30.054847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e1bba7d0-0e70-4afb-9e35-9a027575be85 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.154462 May 11 06:03:30.055412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 414/841] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:29 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:30.055529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Getting quotas for user aa2d83bcc02a43f89ba4785a9bdedd15 and project 2279e41c4ffe455d9f5d126d3d288333. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:30.066926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:03:30.069233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:03:30.114205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bb318b0b-81b3-4009-8030-4ea98cc261ca tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.562149 May 11 06:03:30.114846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 428/842] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:03:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:03:30.125691 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0d7bed24-f6d5-4ec5-9f08-f68ebb641942 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:30.126553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0d7bed24-f6d5-4ec5-9f08-f68ebb641942 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:30.182778 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0d7bed24-f6d5-4ec5-9f08-f68ebb641942 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:30.193297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0d7bed24-f6d5-4ec5-9f08-f68ebb641942 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1237 microversion: 2.1 time: 0.072033 May 11 06:03:30.194291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 415/843] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:30 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:30.652492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:30.653733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:30.661277 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:30.661920 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:30.662809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:30.663474 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:30.796911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:30.804458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ff95f5da-f690-4446-baaa-d5ad08b565fc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1680 microversion: 2.1 time: 0.156113 May 11 06:03:30.805108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 429/844] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:30 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:31.072314 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:31.073204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:31.079904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.080431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.081220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.081856 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.212012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:31.212969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:31.237839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.240389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.241227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.241724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.332044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:31.339467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-55e87ff0-ff14-4728-ad72-7957263ef9dd tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.271043 May 11 06:03:31.343628 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 416/845] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:31 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:31.353710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-04cd039d-7aa5-41d2-91b0-283b46c372b7 req-e8d32001-09a5-4c2e-918c-9be664c5d6bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efab7ed-d556-45bf-b471-e4783656823e", "name": "network-vif-deleted", "tag": "fc5e2573-0bba-471d-82b1-607439df47ab"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:31.357314 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:31.367545 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-04cd039d-7aa5-41d2-91b0-283b46c372b7 req-e8d32001-09a5-4c2e-918c-9be664c5d6bc service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.368304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-04cd039d-7aa5-41d2-91b0-283b46c372b7 req-e8d32001-09a5-4c2e-918c-9be664c5d6bc service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.375206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3e20c416-4291-400b-9844-59ee9d3b176f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1297 microversion: 2.1 time: 0.166020 May 11 06:03:31.376956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 430/846] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:31 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1297 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:31.391605 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-04cd039d-7aa5-41d2-91b0-283b46c372b7 req-e8d32001-09a5-4c2e-918c-9be664c5d6bc service nova] Creating event network-vif-deleted:fc5e2573-0bba-471d-82b1-607439df47ab for instance 4efab7ed-d556-45bf-b471-e4783656823e on hv-cinder-73362 May 11 06:03:31.406679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-04cd039d-7aa5-41d2-91b0-283b46c372b7 req-e8d32001-09a5-4c2e-918c-9be664c5d6bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061732 May 11 06:03:31.407594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 417/847] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:31.822725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:31.823431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:31.830491 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.831036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.831875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.832408 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.865590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:31.866312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:31.866771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'fault' on Instance uuid 4efab7ed-d556-45bf-b471-e4783656823e {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:31.916929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:31.925728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-56ee0c67-169c-489c-b710-1f6b615f03d1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 200 len: 1331 microversion: 2.1 time: 0.106582 May 11 06:03:31.926239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 431/848] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:31 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:32.358961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:32.359491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:32.368472 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.368943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.369871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.370286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.395696 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:32.396464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:32.405938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.406769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.408105 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.408767 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.527876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:32.537845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9e6855ba-efc1-4de5-a40a-f90e75523636 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.185192 May 11 06:03:32.538600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 418/849] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:32 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:32.644298 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:32.652112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-46aeecf0-65cf-4cfb-9b36-10b0f639c259 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.260416 May 11 06:03:32.652939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 432/850] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:32 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:32.944606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:32.945366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:32.952220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.952844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.953768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:32.954281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:32.970859 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e HTTP/1.1 May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:32.972734 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:03:32.974374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '4efab7ed-d556-45bf-b471-e4783656823e'} May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:32.978661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:03:32.980088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:32.981391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:32.981391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-51ba56a5-888d-4765-9e8b-40436523b78f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 404 len: 111 microversion: 2.1 time: 0.034650 May 11 06:03:32.981391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 419/851] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:32 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:03:32.984005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a3d183b9-1cd6-49d4-a147-6f669b209786 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '.version_select at 0x7fa1440e8e50>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:33.005137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a3d183b9-1cd6-49d4-a147-6f669b209786 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874338336" status: 202 len: 0 microversion: 2.1 time: 0.025372 May 11 06:03:33.006109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 433/852] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 06:03:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874338336 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:03:33.441120 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1cb3fa16-3bc4-46c8-9c50-67a77da02e1c req-f7b19f88-789f-4a14-b5d0-81204a828014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b347d8e-b37a-4081-834a-c25569880ac3", "tag": "6c58b2d0-18cb-4cf4-8be6-a437e75d6164"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:33.456225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1cb3fa16-3bc4-46c8-9c50-67a77da02e1c req-f7b19f88-789f-4a14-b5d0-81204a828014 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.457799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1cb3fa16-3bc4-46c8-9c50-67a77da02e1c req-f7b19f88-789f-4a14-b5d0-81204a828014 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.478136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1cb3fa16-3bc4-46c8-9c50-67a77da02e1c req-f7b19f88-789f-4a14-b5d0-81204a828014 service nova] Creating event network-changed:6c58b2d0-18cb-4cf4-8be6-a437e75d6164 for instance 0b347d8e-b37a-4081-834a-c25569880ac3 on hv-cinder-73362 May 11 06:03:33.483054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1cb3fa16-3bc4-46c8-9c50-67a77da02e1c req-f7b19f88-789f-4a14-b5d0-81204a828014 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047067 May 11 06:03:33.487361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 420/853] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:33.526629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:33.527425 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:33.535469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.537093 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.538149 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.539354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.557212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:33.558475 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:33.566822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.567708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.568770 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.569724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.683006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'services' on Instance uuid 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:33.768279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-29a6edc7-73e9-4def-8573-63329b3f64a0 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments/535edb90-ef57-41c6-ba4b-9d3ee628bc5c" status: 202 len: 0 microversion: 2.1 time: 0.245661 May 11 06:03:33.769127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 434/854] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:03:33 2022] DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments/535edb90-ef57-41c6-ba4b-9d3ee628bc5c => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:03:33.778229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:33.779197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:33.799826 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.800277 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.801175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.801642 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.822558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:33.831991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b4815f70-3271-49c6-b159-350b81d8ecc8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.279290 May 11 06:03:33.832811 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 421/855] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:33 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:33.840952 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:33.844007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:33.850172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.850746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.851732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:33.852268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:33.890949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a689263a-dc5b-4f10-9d62-6c382e14111b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056156 May 11 06:03:33.892086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 422/856] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:33 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:33.988120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:33.996493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5dcd4bcc-cbc5-40ae-8a89-d67a8bf3f860 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.222757 May 11 06:03:33.997187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 435/857] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:33 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:34.098708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1bafabfd-072f-4580-9d74-8666fc51f3e2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: .version_select at 0x7fa13ae8adc0>, body: {"keypair": {"name": "tempest-keypair-1564856824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpcG7ni9wa4B139Yg1v9tdOfuxX7J21NsUxKMyk9Yawe4g+62+UDcflqO4/BtXT8YO0oF9Fy0QHDOl28cDM0wTMQQw2XNnWjRM+yfLb0nyVuHQJiZivD1FI3/qQrb9kaA=="}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:34.112160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-1bafabfd-072f-4580-9d74-8666fc51f3e2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:34.115969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-1bafabfd-072f-4580-9d74-8666fc51f3e2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'key_pairs'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:34.136604 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1bafabfd-072f-4580-9d74-8666fc51f3e2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.041745 May 11 06:03:34.137169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 423/858] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 06:03:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:34.849493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:34.850231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:34.856045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:34.856503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:34.857279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:34.857744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:34.909633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:34.912667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:34.924386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:34.925209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:34.926579 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:34.927331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:34.966671 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-342a4fea-01e3-424f-9316-b762be3d57a1 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066958 May 11 06:03:34.972495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 424/859] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:34 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:34.992038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:35.003760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e2b8859a-df38-41f2-ae29-7c0acbbc44eb tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.158194 May 11 06:03:35.004438 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 436/860] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:34 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:35.018331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:35.019074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:35.025206 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:35.025751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:35.026602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:35.027109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:35.218599 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:35.225759 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e7e170a9-fbef-4e33-8153-a989fd35cfbf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.216110 May 11 06:03:35.226327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 425/861] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:35 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:35.519451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195780392", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "28dde216-4b2f-4353-ba38-412714627bb9"}], "security_groups": [{"name": "tempest-securitygroup--948959654"}], "key_name": "tempest-keypair-1564856824", "user_data": "}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:35.662658 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] validate_networks() for [('28dde216-4b2f-4353-ba38-412714627bb9', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:03:35.979233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:35.980356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:35.987638 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:35.988169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:35.988949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:35.989395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.018714 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-05286e18-3a64-47be-b99d-556c1116a7ce tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043714 May 11 06:03:36.019283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 426/862] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:03:35 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:03:36.024000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:36.024636 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:36.031992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.031992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.032730 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.033158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.196540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:36.203993 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-350d1a90-a414-4898-b42a-81c9123d1f6f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.183599 May 11 06:03:36.204579 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 427/863] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:36 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:36.209571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:36.210284 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:36.216833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.218168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.218960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.219404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.245302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:36.325931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:03:36.326538 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:03:36.326856 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:03:36.327268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:03:36.327674 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:03:36.336724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1819e455-98d5-4d36-aaee-3a961dae70f4 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 204 len: 0 microversion: 2.1 time: 0.130466 May 11 06:03:36.337500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 428/864] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:36 2022] DELETE /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:03:36.344191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:36.344921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:36.351133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.351272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.352043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.352481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.360135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.360593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.361407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.366394 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.383347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:03:36.387229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Getting quotas for user 4892d58f399a44b485514cb29f2259b1 and project 34db399b717b42f18c5190acb605918f. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:03:36.398855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:03:36.401112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:03:36.450459 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fabad9b9-7ea4-46c4-b406-2c79ec42ad3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.936081 May 11 06:03:36.451437 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 437/865] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:03:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:03:36.456405 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:36.457042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:36.464723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.465181 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.466009 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:36.466453 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:36.498924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:36.507067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ec74d323-3d18-482f-b8dd-224df0ea36dc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.168215 May 11 06:03:36.509107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 429/866] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:36 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:36.513287 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ed1de18e-bcd8-4332-b870-6ad4808f49f5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:36.513936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ed1de18e-bcd8-4332-b870-6ad4808f49f5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:36.573264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ed1de18e-bcd8-4332-b870-6ad4808f49f5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:36.580962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ed1de18e-bcd8-4332-b870-6ad4808f49f5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1242 microversion: 2.1 time: 0.072214 May 11 06:03:36.589114 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 430/867] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:36 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:36.618815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:36.626697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-364c3469-ee58-4b65-aa65-ac18ed589885 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1688 microversion: 2.1 time: 0.174152 May 11 06:03:36.627324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 438/868] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:36 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:37.221370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:37.222029 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:37.228600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.229061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.229873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.230314 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.379239 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:37.387485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6d507564-6152-47c6-b29c-7ecb46971b4a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.170974 May 11 06:03:37.388060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 431/869] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:37 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:37.524202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:37.524818 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:37.531810 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.532264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.533033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.533486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.598679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:37.599333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:37.606427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.606878 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.607651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.608144 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.669295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:37.672250 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:37.677299 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6ff75b0e-24c8-438e-b607-c31f3e59460a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1246 microversion: 2.1 time: 0.082547 May 11 06:03:37.678236 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 432/870] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:37 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:37.679772 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5223b2aa-e004-4279-a555-5ebc773f4d51 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.159427 May 11 06:03:37.680487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 439/871] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:37 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:37.682735 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:37.683349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:37.690397 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.690843 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.691612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:37.692053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:37.817904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:37.825142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d8a3ab7b-bce1-43ec-8686-bf56ce328ade tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1688 microversion: 2.1 time: 0.145958 May 11 06:03:37.825766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 433/872] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:37 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:38.403629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-36d1e5e9-bfab-48ab-9bdd-ea9f60747462 req-ab1c6803-3003-4777-8e98-8da7a8e77f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "name": "network-vif-plugged", "status": "completed", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:38.406933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:38.407594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:38.412467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-36d1e5e9-bfab-48ab-9bdd-ea9f60747462 req-ab1c6803-3003-4777-8e98-8da7a8e77f8f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.412921 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-36d1e5e9-bfab-48ab-9bdd-ea9f60747462 req-ab1c6803-3003-4777-8e98-8da7a8e77f8f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.417355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.418225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.419482 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.421558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.424920 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-36d1e5e9-bfab-48ab-9bdd-ea9f60747462 req-ab1c6803-3003-4777-8e98-8da7a8e77f8f service nova] Creating event network-vif-plugged:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:03:38.430201 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-36d1e5e9-bfab-48ab-9bdd-ea9f60747462 req-ab1c6803-3003-4777-8e98-8da7a8e77f8f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092172 May 11 06:03:38.433860 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 440/873] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:38.561550 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:38.569312 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-63232166-154d-4d7e-83d6-03954ec9d424 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.167978 May 11 06:03:38.569913 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 434/874] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:38 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:38.703830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:38.704376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:38.704806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:38.705606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:38.710441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.710898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.711630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.711762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.712080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.712179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.712846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.713282 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.773560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:38.781944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f3fccdd8-06f7-4839-838c-093be30c8923 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1246 microversion: 2.1 time: 0.082646 May 11 06:03:38.782870 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 435/875] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:38 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:38.841232 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:38.848799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d52b6bd3-6422-41ec-9528-3812c6134357 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.149343 May 11 06:03:38.849698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:38.849842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 441/876] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:38 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:38.850220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:38.856116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.856567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.857339 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:38.858350 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:38.984122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:38.991398 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6a5bcc29-a001-4482-ba96-9f0ddcbe2221 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1688 microversion: 2.1 time: 0.146013 May 11 06:03:38.991965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 436/877] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:38 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:39.590360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:39.590360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:39.596513 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.596961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.597763 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.598197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.728807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:39.736137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7d5cee37-32fb-460d-b1cd-deae0032a294 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.153298 May 11 06:03:39.736699 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 442/878] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:39 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:39.798979 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:39.799631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:39.806046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.806497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.807264 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.807703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.866187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:39.866729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:39.871933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:39.872807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.873266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.874824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:39.875268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:39.879696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-170ac07b-39dc-47b3-a27c-49881e241138 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1246 microversion: 2.1 time: 0.084797 May 11 06:03:39.880269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 437/879] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:39 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:40.008980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:40.009618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:40.010758 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:40.016571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.017015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.017808 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.018238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.019658 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bccd3efa-3d05-4e9c-be3d-d768f2e581a6 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.157499 May 11 06:03:40.020252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 443/880] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:39 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:40.150352 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:40.158341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a744732d-fcd2-479a-a323-39de0b466c0b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1688 microversion: 2.1 time: 0.153248 May 11 06:03:40.158917 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 438/881] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:40 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:40.464917 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-5546d140-e719-4615-9933-73045e64c1da req-abf87bf5-d9e1-4370-abda-65ba84b5bdf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b347d8e-b37a-4081-834a-c25569880ac3", "name": "network-vif-plugged", "status": "completed", "tag": "6c58b2d0-18cb-4cf4-8be6-a437e75d6164"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:40.474294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-5546d140-e719-4615-9933-73045e64c1da req-abf87bf5-d9e1-4370-abda-65ba84b5bdf4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.474740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-5546d140-e719-4615-9933-73045e64c1da req-abf87bf5-d9e1-4370-abda-65ba84b5bdf4 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.487725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-5546d140-e719-4615-9933-73045e64c1da req-abf87bf5-d9e1-4370-abda-65ba84b5bdf4 service nova] Creating event network-vif-plugged:6c58b2d0-18cb-4cf4-8be6-a437e75d6164 for instance 0b347d8e-b37a-4081-834a-c25569880ac3 on hv-cinder-73362 May 11 06:03:40.492950 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-5546d140-e719-4615-9933-73045e64c1da req-abf87bf5-d9e1-4370-abda-65ba84b5bdf4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032000 May 11 06:03:40.493586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 444/882] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:40.753411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:40.754194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:40.760314 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.760762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.761610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.762045 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.897004 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:40.897542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:40.897905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:40.904245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.904753 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.905088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c729e1a4-ad33-4c49-aeae-27e1afcad75c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1264 microversion: 2.1 time: 0.156008 May 11 06:03:40.905802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 439/883] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:40 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:40.905922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:40.906276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:40.985123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:40.992615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e98dbeb8-3487-4e46-bd6d-426398b71543 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1294 microversion: 2.1 time: 0.099908 May 11 06:03:40.993657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 445/884] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:40 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:41.036680 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:41.037294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:41.043013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.043453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.044213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.044642 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.179712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:41.186591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:41.187418 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:41.188959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f3aff489-c702-4bf3-aff2-e888d0cc514f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.156027 May 11 06:03:41.189873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 440/885] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:41 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:41.202740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.203223 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.204009 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.204448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.286640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:41.295273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0dc69c2e-7ddd-4653-b0e8-2c4a163dd039 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1621 microversion: 2.1 time: 0.123219 May 11 06:03:41.296558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 446/886] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:41 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1621 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:41.298233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-ac60095b-e72d-4e74-8be6-c8b2290b0df0 req-747660de-ff23-41d4-b49d-dde4badb2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba0054f-a786-4f8b-b701-cebccd1c7fc2", "name": "network-vif-deleted", "tag": "7962c89e-6f9f-4763-994c-e54ddefaf27e"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:41.308355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ac60095b-e72d-4e74-8be6-c8b2290b0df0 req-747660de-ff23-41d4-b49d-dde4badb2b7b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.309088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ac60095b-e72d-4e74-8be6-c8b2290b0df0 req-747660de-ff23-41d4-b49d-dde4badb2b7b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.322122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-ac60095b-e72d-4e74-8be6-c8b2290b0df0 req-747660de-ff23-41d4-b49d-dde4badb2b7b service nova] Creating event network-vif-deleted:7962c89e-6f9f-4763-994c-e54ddefaf27e for instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 on hv-cinder-73362 May 11 06:03:41.328004 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-ac60095b-e72d-4e74-8be6-c8b2290b0df0 req-747660de-ff23-41d4-b49d-dde4badb2b7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035221 May 11 06:03:41.328739 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 441/887] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:03:41.924199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:41.924806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:41.941964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.942771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:41.943591 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:41.944032 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.010664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:42.012059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:42.020113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.020701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.021747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.022413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.089224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:42.097061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3908d6bd-ba87-40bb-9522-efcb9cf34c46 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1300 microversion: 2.1 time: 0.091216 May 11 06:03:42.098292 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 442/888] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:42 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:42.105392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:42.113669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-22d31a7a-55dd-4757-b25d-29076931491d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1450 microversion: 2.1 time: 0.194121 May 11 06:03:42.114239 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 447/889] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:41 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1450 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:42.130412 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:42.131033 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:42.136994 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.137456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.138266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.138712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.207568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:42.208199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:42.215662 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.216117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.216902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.218119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.279247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:42.287626 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1bb1eedf-62b9-4626-9829-ee380decc362 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1450 microversion: 2.1 time: 0.161056 May 11 06:03:42.288193 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 443/890] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:42 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1450 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:42.313450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:42.314136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:42.321187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.321713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.326446 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.326946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.366039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:42.366693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:42.367093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:42.367739 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'fault' on Instance uuid 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:42.376347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fc1b8787-f82e-4004-891a-c1cdd3b41dac tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.174206 May 11 06:03:42.376942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 448/891] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:42 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:42.417462 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:42.427140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-049f87cf-f5da-465e-adeb-67540bde2244 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1335 microversion: 2.1 time: 0.118371 May 11 06:03:42.427860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 444/892] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:42 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1335 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:43.114737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:43.116175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:43.122754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.130257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.131487 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.133275 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.367976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:43.380143 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c70e32b1-a9a6-4dd3-a202-4ec8e5daf576 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.269054 May 11 06:03:43.391060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 449/893] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:43 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:43.394822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:43.395980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:43.403135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.403812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.404964 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.405639 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.444141 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:43.444886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:43.451056 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.451620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.452652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.453174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.484886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:43.485465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:43.486011 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'fault' on Instance uuid 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:43.541754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:43.549743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6d0ee29a-5c11-4167-a25a-55e46b6233fa tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 200 len: 1335 microversion: 2.1 time: 0.109517 May 11 06:03:43.550397 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 450/894] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:43 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:43.614046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:43.626413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9aaa9d1c-9f19-46b0-aa7e-08c373332d41 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1363 microversion: 2.1 time: 0.232512 May 11 06:03:43.637060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 445/895] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:43 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:44.219807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-d12fc011-bd37-450a-95d9-76de9d61ed6a req-afef463c-d5de-4c6c-bf45-652eb381f7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:44.228997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d12fc011-bd37-450a-95d9-76de9d61ed6a req-afef463c-d5de-4c6c-bf45-652eb381f7ed service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.229441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-d12fc011-bd37-450a-95d9-76de9d61ed6a req-afef463c-d5de-4c6c-bf45-652eb381f7ed service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.244357 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-d12fc011-bd37-450a-95d9-76de9d61ed6a req-afef463c-d5de-4c6c-bf45-652eb381f7ed service nova] Creating event network-changed:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:03:44.252209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-554cdf13-8a71-44af-962b-2cdda7304cc4 req-1de28cb7-b206-42bd-9be3-c15e73708812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4fc3fd-bfef-4724-bf48-e90b015479bb", "tag": "17f47768-2a4d-42ae-a06d-f30c25c57200"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:44.268592 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-d12fc011-bd37-450a-95d9-76de9d61ed6a req-afef463c-d5de-4c6c-bf45-652eb381f7ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052325 May 11 06:03:44.269904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 451/896] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:44.273035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-554cdf13-8a71-44af-962b-2cdda7304cc4 req-1de28cb7-b206-42bd-9be3-c15e73708812 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.273496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-554cdf13-8a71-44af-962b-2cdda7304cc4 req-1de28cb7-b206-42bd-9be3-c15e73708812 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.289349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-554cdf13-8a71-44af-962b-2cdda7304cc4 req-1de28cb7-b206-42bd-9be3-c15e73708812 service nova] Creating event network-changed:17f47768-2a4d-42ae-a06d-f30c25c57200 for instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb on hv-cinder-73362 May 11 06:03:44.294407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-554cdf13-8a71-44af-962b-2cdda7304cc4 req-1de28cb7-b206-42bd-9be3-c15e73708812 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046266 May 11 06:03:44.296166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 446/897] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:44.402528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:44.403264 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:44.416153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.416703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.417556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.424103 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.560641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:44.572936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:44.573774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 7ba0054f-a786-4f8b-b701-cebccd1c7fc2] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:44.581593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c2dd695f-23d6-44f4-bff5-b6480dba31cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.187380 May 11 06:03:44.585729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 452/898] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:44 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:44.586718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.587172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.588139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.588589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.606430 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] HTTP exception thrown: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Request method failure captured: May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 HTTP/1.1 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B21o_mpixF3E4vzUVPu6SH0Cex_RVyY9WP2Vv_dzgqFim6zWZ62yKSyx-LSyOczH5Aslqn5zoGxK946bIE9W5sCJvgPEY88T--15dCfBiVlrjuKSEW5VxEmCiUoTChZpnKojdkjPg7ejMdmvgG2GWVIJjr8Jt9AOF9rBHp10j8Zu0 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:44.609228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}] May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 28c76d12b0b1436d8eb0b23acf252f25 May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. May 11 06:03:44.611017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '7ba0054f-a786-4f8b-b701-cebccd1c7fc2'} May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:44.611831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. May 11 06:03:44.613053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:44.616343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Returning 404 to user: Instance 7ba0054f-a786-4f8b-b701-cebccd1c7fc2 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:44.617417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2752590d-d01b-44b0-af2c-3cecc836caa8 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2" status: 404 len: 111 microversion: 2.1 time: 0.053774 May 11 06:03:44.618204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 447/899] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:44 2022] GET /compute/v2.1/servers/7ba0054f-a786-4f8b-b701-cebccd1c7fc2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:03:44.627396 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f53c9992-f080-4380-8cda-5cb9cea8252d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '.version_select at 0x7fa1440e8280>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:44.644592 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:44.646254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:44.653604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f53c9992-f080-4380-8cda-5cb9cea8252d tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178112507" status: 202 len: 0 microversion: 2.1 time: 0.030681 May 11 06:03:44.659843 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.660417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 453/900] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 06:03:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178112507 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:03:44.663245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.664202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.666148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.924961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:44.933840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-51615625-bb1d-420b-a9dc-41e4e65cc94b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1549 microversion: 2.1 time: 0.293900 May 11 06:03:44.936596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 448/901] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:44 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1549 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:44.955347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:44.956117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:44.962941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.964276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:44.965283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:44.966162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:45.172911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-33636a39-f93b-49ef-8a49-6d62126452c3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.224927 May 11 06:03:45.181220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 454/902] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:03:44 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:45.603533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:45.604943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:45.612417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:45.613259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:45.614332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:45.615059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:46.009407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:46.017736 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-611c7540-7a95-4f8f-b458-46450ca25d3d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.418450 May 11 06:03:46.018419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 449/903] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:45 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:46.588769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-2df09d7d-5a5e-4011-913c-3dbf03d68d63 req-42664887-fc24-4d77-adf6-2fa12429456f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b347d8e-b37a-4081-834a-c25569880ac3", "tag": "6c58b2d0-18cb-4cf4-8be6-a437e75d6164"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:46.597271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2df09d7d-5a5e-4011-913c-3dbf03d68d63 req-42664887-fc24-4d77-adf6-2fa12429456f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:46.597764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-2df09d7d-5a5e-4011-913c-3dbf03d68d63 req-42664887-fc24-4d77-adf6-2fa12429456f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:46.608568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-2df09d7d-5a5e-4011-913c-3dbf03d68d63 req-42664887-fc24-4d77-adf6-2fa12429456f service nova] Creating event network-changed:6c58b2d0-18cb-4cf4-8be6-a437e75d6164 for instance 0b347d8e-b37a-4081-834a-c25569880ac3 on hv-cinder-73362 May 11 06:03:46.613369 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-2df09d7d-5a5e-4011-913c-3dbf03d68d63 req-42664887-fc24-4d77-adf6-2fa12429456f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028680 May 11 06:03:46.613978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 455/904] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:47.034563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:47.035189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:47.042536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:47.042987 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:47.043766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:47.044214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:47.187058 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:47.194793 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bfc4d58d-917b-4b57-823f-ac3633e8bef1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.163770 May 11 06:03:47.195586 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 450/905] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:47 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:48.112371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:48.112993 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:48.119017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.119471 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.120237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.120710 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.147805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:48.213089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:48.213747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:48.219898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9889a799-c2a7-416f-974b-5cdc66c7275e tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 204 len: 0 microversion: 2.1 time: 0.111972 May 11 06:03:48.220864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 456/906] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:48 2022] DELETE /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:03:48.223833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.224315 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.225115 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.225603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.230902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:48.230902 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:48.237972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.238431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.239214 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:48.239647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:48.360040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:48.367447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-628da64e-8eda-4766-9fe7-37af5b1300f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.158279 May 11 06:03:48.368227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 451/907] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:48 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:48.374171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:48.381461 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-64c58c4d-5109-494b-8931-9afeebe2632b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1507 microversion: 2.1 time: 0.156394 May 11 06:03:48.382040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 457/908] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:48 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:49.385195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:49.385912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:49.392656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:49.393127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:49.394020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:49.394826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:49.399717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:49.400407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:49.406845 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:49.407297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:49.408065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:49.408503 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:49.524187 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:49.532389 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bb0bbbc8-a4d8-4e78-b426-b31864678e2a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.151058 May 11 06:03:49.532966 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 452/909] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:49 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:49.537946 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:49.546237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1627717a-2e89-4f60-a629-6bf0cb9ee4e5 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1507 microversion: 2.1 time: 0.150292 May 11 06:03:49.546807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 458/910] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:49 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:50.155635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-a55fe7b2-b80f-4c19-925f-b123ce4ab5a2 req-65a5f14d-7fab-4f6f-8d0e-b02270f16572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673a67a9-f3f8-4070-b0e1-fb905b0f5dbc", "name": "network-vif-deleted", "tag": "23a46e18-b3c4-4987-94de-348690945cd6"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:50.163558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a55fe7b2-b80f-4c19-925f-b123ce4ab5a2 req-65a5f14d-7fab-4f6f-8d0e-b02270f16572 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.164000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-a55fe7b2-b80f-4c19-925f-b123ce4ab5a2 req-65a5f14d-7fab-4f6f-8d0e-b02270f16572 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.186164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-a55fe7b2-b80f-4c19-925f-b123ce4ab5a2 req-65a5f14d-7fab-4f6f-8d0e-b02270f16572 service nova] Creating event network-vif-deleted:23a46e18-b3c4-4987-94de-348690945cd6 for instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc on hv-cinder-73362 May 11 06:03:50.192266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-a55fe7b2-b80f-4c19-925f-b123ce4ab5a2 req-65a5f14d-7fab-4f6f-8d0e-b02270f16572 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040932 May 11 06:03:50.193063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 453/911] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:50.549442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:50.550213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:50.556831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.557569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.559187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.559630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.564827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:50.565561 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:50.571876 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.572265 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.573038 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.573632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.606475 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:50.606920 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:50.608071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'fault' on Instance uuid 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:50.652082 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:50.660726 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-be1eb5f0-901c-4b33-92d6-5360b38fae9b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 200 len: 1312 microversion: 2.1 time: 0.101101 May 11 06:03:50.661875 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 454/912] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:50 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:50.699709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:50.707927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ea50c8f7-3385-4f6c-aeb0-0bbef5e61c6f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.163247 May 11 06:03:50.708545 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 459/913] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:50 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:51.678575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:51.679318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:51.685738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.686189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.686958 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.687392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.700702 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] HTTP exception thrown: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Request method failure captured: May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc HTTP/1.1 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B21o_mpixF3E4vzUVPu6SH0Cex_RVyY9WP2Vv_dzgqFim6zWZ62yKSyx-LSyOczH5Aslqn5zoGxK946bIE9W5sCJvgPEY88T--15dCfBiVlrjuKSEW5VxEmCiUoTChZpnKojdkjPg7ejMdmvgG2GWVIJjr8Jt9AOF9rBHp10j8Zu0 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:51.703250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}] May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 28c76d12b0b1436d8eb0b23acf252f25 May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. May 11 06:03:51.704874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '673a67a9-f3f8-4070-b0e1-fb905b0f5dbc'} May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:51.705822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. May 11 06:03:51.707331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:51.708698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Returning 404 to user: Instance 673a67a9-f3f8-4070-b0e1-fb905b0f5dbc could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:51.708698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2b1f462f-b135-4cd5-bece-7d9c7be7496b tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc" status: 404 len: 111 microversion: 2.1 time: 0.030715 May 11 06:03:51.708698 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 455/914] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:51 2022] GET /compute/v2.1/servers/673a67a9-f3f8-4070-b0e1-fb905b0f5dbc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:03:51.713938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:51.714439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:51.721375 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.721941 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.722745 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.723185 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.724179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:51.724796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:51.730944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.731403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.732183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.732667 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.760606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:03:51.836427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a14037a6-d6c0-4725-a0cc-9e01d885b158 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 204 len: 0 microversion: 2.1 time: 0.125958 May 11 06:03:51.840771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 460/915] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:03:51 2022] DELETE /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:03:51.847616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:51.848314 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:51.854783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.855269 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.856177 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:51.856614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:51.870269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:51.878340 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3b0577a7-9045-4b64-bc63-9d814c8703c0 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.158084 May 11 06:03:51.879086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 456/916] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:51 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:51.988629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:51.995877 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4fc687d2-30ab-4850-a5f6-3ab827775e94 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.153057 May 11 06:03:51.996444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 461/917] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:51 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:52.266052 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-16f305ee-1858-4999-aea4-7a64fc6e2cd7 req-d016e2ad-1be7-4aec-ad55-0b03370654bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4fc3fd-bfef-4724-bf48-e90b015479bb", "name": "network-vif-plugged", "status": "completed", "tag": "17f47768-2a4d-42ae-a06d-f30c25c57200"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:52.275296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-16f305ee-1858-4999-aea4-7a64fc6e2cd7 req-d016e2ad-1be7-4aec-ad55-0b03370654bb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:52.275830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-16f305ee-1858-4999-aea4-7a64fc6e2cd7 req-d016e2ad-1be7-4aec-ad55-0b03370654bb service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:52.287590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-16f305ee-1858-4999-aea4-7a64fc6e2cd7 req-d016e2ad-1be7-4aec-ad55-0b03370654bb service nova] Creating event network-vif-plugged:17f47768-2a4d-42ae-a06d-f30c25c57200 for instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb on hv-cinder-73362 May 11 06:03:52.292544 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-16f305ee-1858-4999-aea4-7a64fc6e2cd7 req-d016e2ad-1be7-4aec-ad55-0b03370654bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030641 May 11 06:03:52.293143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 457/918] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:52.895129 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:52.895711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:52.902145 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:52.902596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:52.903365 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:52.903805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:53.015275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:53.016364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:53.022935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:53.023467 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:53.024357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:53.024921 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:53.027976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:53.035779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-74ec20a5-f871-4a2c-a8bf-4ef7ca371520 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.144551 May 11 06:03:53.036363 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 462/919] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:52 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:53.154096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:53.161907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b4fa3397-1481-4c90-a989-cd1c0316339f tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.151404 May 11 06:03:53.162483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 458/920] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:53 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:54.052454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:54.053146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:54.059437 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:54.059892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:54.061535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:54.061979 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:54.179716 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:54.180333 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:54.187729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:54.188177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:54.188992 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:54.189459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:54.195648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:54.202974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-79475e7e-da6b-4464-a1e9-9df23726c7a6 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.154387 May 11 06:03:54.203552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 463/921] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:54 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:54.322835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:54.330564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-afcd3e35-a59e-46e6-b6e6-cff9ae9e5e15 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1520 microversion: 2.1 time: 0.155357 May 11 06:03:54.331124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 459/922] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:54 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:55.219372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:55.220023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:55.222782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1e0fe596-9094-48a9-bbcd-1b9479b86bd8 req-719c4784-0125-4432-bdf6-916a10a033d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca", "name": "network-vif-deleted", "tag": "e811e3dd-5519-4c8a-89e5-30c7a6732ff9"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:55.226431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:55.227012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:55.227899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:55.228399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:55.231190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1e0fe596-9094-48a9-bbcd-1b9479b86bd8 req-719c4784-0125-4432-bdf6-916a10a033d0 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:55.231643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1e0fe596-9094-48a9-bbcd-1b9479b86bd8 req-719c4784-0125-4432-bdf6-916a10a033d0 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:55.243849 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1e0fe596-9094-48a9-bbcd-1b9479b86bd8 req-719c4784-0125-4432-bdf6-916a10a033d0 service nova] Creating event network-vif-deleted:e811e3dd-5519-4c8a-89e5-30c7a6732ff9 for instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca on hv-cinder-73362 May 11 06:03:55.249911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1e0fe596-9094-48a9-bbcd-1b9479b86bd8 req-719c4784-0125-4432-bdf6-916a10a033d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031126 May 11 06:03:55.250514 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 460/923] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:55.347585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:55.348276 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:55.354349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:55.354801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:55.355573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:55.356003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:55.356477 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:55.365031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0e576b23-eb87-41cb-b9ea-045d33bc8d5d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.149843 May 11 06:03:55.365785 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 464/924] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:55 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:55.425580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:55.433085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6d1da5a8-1dc8-443f-bb1e-c2b2e5530cae tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1478 microversion: 2.1 time: 0.089672 May 11 06:03:55.433701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 461/925] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:55 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1478 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:56.383016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:56.383635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:56.390973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:56.391433 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:56.392204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:56.392642 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:56.451548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:56.452417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:56.459722 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:56.460591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:56.461443 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:56.462906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:56.502823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:56.503268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:56.503718 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lazy-loading 'fault' on Instance uuid d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:03:56.543705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28c76d12b0b1436d8eb0b23acf252f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d84ee8b78144447bef24d677ad32b3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:56.543864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:56.551096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a7d98197-9be1-4a50-b45f-98aaf98670dd tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 200 len: 1311 microversion: 2.1 time: 0.104167 May 11 06:03:56.551685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 462/926] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:56 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:56.551829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1eb0cff8-cfaf-4fa5-a2c8-44e980f5e4f9 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1367 microversion: 2.1 time: 0.172588 May 11 06:03:56.552344 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 465/927] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:56 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:03:57.568291 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:57.569022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] [instance: d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:57.569227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:57.569873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:57.575433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.576772 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.576922 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.577321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.577840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.578156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.578413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.578605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.592863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] HTTP exception thrown: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Request method failure captured: May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca HTTP/1.1 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B21o_mpixF3E4vzUVPu6SH0Cex_RVyY9WP2Vv_dzgqFim6zWZ62yKSyx-LSyOczH5Aslqn5zoGxK946bIE9W5sCJvgPEY88T--15dCfBiVlrjuKSEW5VxEmCiUoTChZpnKojdkjPg7ejMdmvgG2GWVIJjr8Jt9AOF9rBHp10j8Zu0 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:03:57.594557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d84ee8b78144447bef24d677ad32b3c"}]}] May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 8d84ee8b78144447bef24d677ad32b3c May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718300085 May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 28c76d12b0b1436d8eb0b23acf252f25 May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718300085-project May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. May 11 06:03:57.595914 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'd45d7dad-15ad-4274-ab0c-6c7c4a6f9bca'} May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:03:57.596682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. May 11 06:03:57.598302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:03:57.599421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] Returning 404 to user: Instance d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:03:57.599421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f0b0d181-732f-497e-bcac-7eccb18a1b14 tempest-ServerRescueNegativeTestJSON-1718300085 tempest-ServerRescueNegativeTestJSON-1718300085-project] 10.222.0.44 "GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca" status: 404 len: 111 microversion: 2.1 time: 0.031723 May 11 06:03:57.599421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 463/928] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:57 2022] GET /compute/v2.1/servers/d45d7dad-15ad-4274-ab0c-6c7c4a6f9bca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:03:57.721323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:03:57.729113 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7739dad9-b9e6-4ebd-8e36-57a7db49f23f tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1556 microversion: 2.1 time: 0.164532 May 11 06:03:57.730095 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 466/929] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:03:57 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:03:57.746234 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:57.746747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:57.753568 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.754018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.754806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:57.755438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:57.870582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f3ddf4fb-7219-4a8e-901d-230e09407989 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128309 May 11 06:03:57.871172 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 464/930] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 06:03:57 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:03:58.158490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:03:58.159031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:03:58.165552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:58.166015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:58.166794 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:58.167235 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:58.196160 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7d2f6ea5-0276-4df0-be1f-c48f1b387705 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.042382 May 11 06:03:58.197018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 467/931] 10.222.0.44 () {60 vars in 1288 bytes} [Wed May 11 06:03:58 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:03:59.189768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-cd48f7f4-3095-4ec2-ab46-566443487da5 req-d6d9995d-1672-4270-a34b-5dba21187d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f4fc3fd-bfef-4724-bf48-e90b015479bb", "tag": "17f47768-2a4d-42ae-a06d-f30c25c57200"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:03:59.197985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-cd48f7f4-3095-4ec2-ab46-566443487da5 req-d6d9995d-1672-4270-a34b-5dba21187d98 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:03:59.198646 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-cd48f7f4-3095-4ec2-ab46-566443487da5 req-d6d9995d-1672-4270-a34b-5dba21187d98 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:03:59.230486 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-cd48f7f4-3095-4ec2-ab46-566443487da5 req-d6d9995d-1672-4270-a34b-5dba21187d98 service nova] Creating event network-changed:17f47768-2a4d-42ae-a06d-f30c25c57200 for instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb on hv-cinder-73362 May 11 06:03:59.239093 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-cd48f7f4-3095-4ec2-ab46-566443487da5 req-d6d9995d-1672-4270-a34b-5dba21187d98 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054022 May 11 06:03:59.239705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 465/932] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:00.163663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:00.164880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:00.185568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:00.186233 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:00.187069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:00.187629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:00.222596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lazy-loading 'flavor' on Instance uuid 5020c511-6684-4f25-8d07-840612e810f0 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:04:00.526891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-13875e30-7097-44ed-8b7f-2cebb90eeefc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/action" status: 202 len: 0 microversion: 2.20 time: 0.366790 May 11 06:04:00.528040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 468/933] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 06:04:00 2022] POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:04:00.546248 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:00.547871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:00.561629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:00.562772 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:00.564121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:00.565055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:00.821232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:00.829866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:00.831402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:00.832581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1121ce31-7c96-49d3-b6de-2f08e45df4bd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.298846 May 11 06:04:00.833179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 466/934] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:00 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:01.851965 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:01.852775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:01.859062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:01.859522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:01.860299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:01.860739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:01.991906 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:01.999942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:02.001454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:02.003051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f2429b7a-5450-416b-af09-0f5d3f278a96 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.155535 May 11 06:04:02.003613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 469/935] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:01 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:02.215087 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d1b04b5b-5bf7-43aa-90e9-9324e0080bfe tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Action: 'create', calling method: .version_select at 0x7fa13af5e820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1268738197", "metadata": {"Type": "work"}}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:02.490097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d1b04b5b-5bf7-43aa-90e9-9324e0080bfe tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.386820 May 11 06:04:02.496740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 467/936] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 06:04:02 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 388 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 06:04:02.503346 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c453d28e-fe73-4a95-b111-6c18944fd8ea tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa14409e9d0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:02.556325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c453d28e-fe73-4a95-b111-6c18944fd8ea tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 200 len: 353 microversion: 2.1 time: 0.057422 May 11 06:04:02.556899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 470/937] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:04:02 2022] GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:03.022115 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:03.022727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:03.029417 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:03.029889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:03.030662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:03.031094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:03.161365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:03.169181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:03.171909 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:03.173077 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7ce35a6b-676d-4fe7-a0f0-14da5e00a9fb tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.155239 May 11 06:04:03.173673 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 468/938] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:03 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:03.569983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fe8657e2-55bf-4018-b2a5-9f62825184f5 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa1400954c0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:03.615989 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fe8657e2-55bf-4018-b2a5-9f62825184f5 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 200 len: 354 microversion: 2.1 time: 0.050419 May 11 06:04:03.616565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 471/939] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:04:03 2022] GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:03.627372 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5f093c70-3587-4aa1-979c-dfbe9b8e38ab tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa13af03310>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:03.673293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5f093c70-3587-4aa1-979c-dfbe9b8e38ab tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 200 len: 354 microversion: 2.1 time: 0.049657 May 11 06:04:03.673887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 469/940] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:04:03 2022] GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:03.689564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-25ecfc6a-c036-4e1f-9714-d814bc08a8cc tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa14405d430>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:03.750015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-25ecfc6a-c036-4e1f-9714-d814bc08a8cc tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 202 len: 0 microversion: 2.1 time: 0.064225 May 11 06:04:03.750586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 472/941] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:04:03 2022] DELETE /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:04:03.759063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-06355886-fa11-4bd6-97ec-d844823e4db4 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa13af5eee0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:03.806028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-06355886-fa11-4bd6-97ec-d844823e4db4 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 200 len: 353 microversion: 2.1 time: 0.051108 May 11 06:04:03.806598 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 470/942] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:04:03 2022] GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:04.191947 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:04.192560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:04.198918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:04.199395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:04.200190 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:04.201326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:04.327156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:04.334857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:04.336347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:04.337495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-eb50df58-ec0d-4eb4-8126-21b9d7b2ed69 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.149427 May 11 06:04:04.338059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 473/943] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:04 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:04:04.819258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80c948cf-53da-4820-bd62-bd3ff164eb93 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Calling method '.version_select at 0x7fa13af15310>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:04.851373 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-80c948cf-53da-4820-bd62-bd3ff164eb93 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] HTTP exception thrown: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80c948cf-53da-4820-bd62-bd3ff164eb93 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Request method failure captured: May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a HTTP/1.1 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1HSKV7CRXHIeY5x1R-VHl3bNIQqiWnS0ZCHgALULgDiGUe2EmV75tFDXNseF6qQ38cZOskfadpFdHJLIFKi4voRzerhC42ocY5obUWXbJWH1qc2VjrTo0wO4fuhLK7WpvqkFuxVvpB7A816gexYTWQiWCGSEGSkLeugOM2itXLkI2g May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: cbd64f1a27a649ed8b6bb1fe32e1cff8 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesGetTestJSON-653579035 May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:04:04.863649 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cbd64f1a27a649ed8b6bb1fe32e1cff8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cbd64f1a27a649ed8b6bb1fe32e1cff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbd64f1a27a649ed8b6bb1fe32e1cff8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cbd64f1a27a649ed8b6bb1fe32e1cff8"}]}] May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesGetTestJSON-653579035 May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: cbd64f1a27a649ed8b6bb1fe32e1cff8 May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesGetTestJSON-653579035 May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesGetTestJSON-653579035-project May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 29212c53b0814404afc4fbdd41e7bbaf May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesGetTestJSON-653579035-project May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '3b67312c-31ab-459b-ac99-d53d336d909a'} May 11 06:04:04.865439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. (HTTP 404) (Request-ID: req-df147dd6-ced7-44c6-82f5-976edf89c58e) May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:04:04.866474 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:04:04.868026 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:04:04.870252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-80c948cf-53da-4820-bd62-bd3ff164eb93 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] Returning 404 to user: Volume 3b67312c-31ab-459b-ac99-d53d336d909a could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-80c948cf-53da-4820-bd62-bd3ff164eb93 tempest-VolumesGetTestJSON-653579035 tempest-VolumesGetTestJSON-653579035-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a" status: 404 len: 109 microversion: 2.1 time: 0.050416 May 11 06:04:04.871661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 471/944] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:04:04 2022] GET /compute/v2.1/os-volumes/3b67312c-31ab-459b-ac99-d53d336d909a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:04:05.356001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:05.357615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:05.364535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:05.364996 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:05.365836 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:05.366279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:05.512447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:05.521641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:05.523175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:05.524333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-058c99d0-5ec4-474a-a3ed-65198f7c28d1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.172349 May 11 06:04:05.525065 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 474/945] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:05 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:06.545357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:06.546024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:06.552000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:06.552402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:06.553177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:06.553673 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:06.682622 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:06.690764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:06.692281 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:06.693441 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c9100a22-1bba-4b90-a832-5b32b83e7c35 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.153241 May 11 06:04:06.694007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 472/946] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:06 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:07.710878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:07.711494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:07.718176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:07.718630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:07.719411 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:07.719846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:07.856301 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:07.864732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:07.866377 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:07.867569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-b97ee347-1b0d-41a0-bf07-6aa16376da7b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.160554 May 11 06:04:07.868142 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 475/947] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:07 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:08.885054 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:08.885700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:08.892582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:08.893036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:08.893847 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:08.894286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:09.072211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:09.080632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:09.082180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:09.083341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9ca294c6-37bc-4ae7-9961-6350d99d82f4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.202204 May 11 06:04:09.094548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 473/948] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:08 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:10.103148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:10.104199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:10.112060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:10.112776 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:10.114068 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:10.114830 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:10.254372 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:10.262520 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:10.264835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:10.266375 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-96a6635a-0339-4a6e-b67b-e081f7134811 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.168221 May 11 06:04:10.267322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 476/949] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:10 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:11.284303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:11.284917 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:11.291261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:11.291701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:11.292454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:11.292882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:11.423696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:11.431476 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:11.432978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:11.434168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c469a465-a549-4da1-956e-cac570d8269d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.153877 May 11 06:04:11.434845 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 474/950] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:11 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:12.452898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:12.453431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:12.459684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:12.460135 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:12.460896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:12.461329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:12.587722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:12.595466 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:12.596971 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:12.598151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5da9c290-1c28-4e3e-bac7-ca53d69dd053 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.149978 May 11 06:04:12.598716 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 477/951] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:12 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:13.616295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:13.616837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:13.623965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:13.624420 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:13.625197 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:13.625669 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:13.751866 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:13.759609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:13.761240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:13.763456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-393f9d24-ef63-48b1-b0ee-0d427b282a46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.151203 May 11 06:04:13.764016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 475/952] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:13 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:14.782245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:14.782845 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:14.789104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:14.789583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:14.790349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:14.790787 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:14.918411 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:14.926175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:14.927681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:14.928838 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-301331d5-911d-4753-b74b-343e5533dbb2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.151150 May 11 06:04:14.929402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 478/953] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:14 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:15.947098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:15.947747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:15.954923 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:15.955371 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:15.956167 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:15.956600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:16.080332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:16.088056 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:16.089584 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:16.090772 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2f9a2582-058a-4e19-9e58-f0dfa10e50f9 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.147655 May 11 06:04:16.091337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 476/954] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:15 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:17.108954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:17.109596 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:17.115942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:17.116395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:17.117165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:17.117637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:17.246391 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:17.254169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:17.255657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:17.256801 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c6709e86-9a45-4885-a613-72c0c9f59f05 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.151922 May 11 06:04:17.257367 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 479/955] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:17 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:18.274617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:18.275237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:18.281723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:18.282170 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:18.283922 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:18.284355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:18.412135 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:18.420064 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:18.421602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:18.422771 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ee08247a-beb0-4046-bd5c-6540985697ff tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.152074 May 11 06:04:18.423313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 477/956] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:18 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:19.440711 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:19.441258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:19.447574 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:19.448025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:19.448789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:19.449222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:19.578532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:19.586703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:19.588299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:19.589768 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-07cb8f0e-d8a4-4183-9deb-4b6f09aaf954 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.152901 May 11 06:04:19.601504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 480/957] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:19 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:20.609313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:20.610006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:20.616558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:20.617010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:20.617811 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:20.618247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:20.745794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:20.754613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:20.756057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:20.757213 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f6a0a34a-7a6f-485e-8a42-4611821aeadc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.152010 May 11 06:04:20.758007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 478/958] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:20 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:21.775611 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:21.776213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:21.783707 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:21.784169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:21.784940 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:21.785382 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:21.914341 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:21.922087 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:21.923579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:21.924720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-09dd01ac-6abc-43c3-969c-1150ce3faeda tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.153064 May 11 06:04:21.925283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 481/959] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:21 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:22.942601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:22.943208 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:22.949585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:22.950072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:22.950828 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:22.951257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:23.083330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:23.091748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:23.093256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:23.094454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-91937dd2-eb47-4161-baf0-68fdfc2493fd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.155810 May 11 06:04:23.095017 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 479/960] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:22 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:24.112792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:24.113413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:24.119780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:24.120229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:24.120997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:24.121434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:24.248983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:24.257912 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:24.259434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:24.260636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f8345600-a2de-47fb-8341-9d8765224c6d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.151744 May 11 06:04:24.261206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 482/961] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:24 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:25.278998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:25.279642 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:25.285998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:25.286449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:25.287223 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:25.287660 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:25.420369 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:25.429962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:25.431466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:25.432617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e727d7ef-9db3-4218-997f-8f434e2e461a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.157570 May 11 06:04:25.433176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 480/962] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:25 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:26.452245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:26.452976 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:26.460448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:26.461105 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:26.463500 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:26.463500 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:26.598106 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:26.605949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:26.607519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:26.608670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ba15df52-454f-42d0-b055-2ad442539b2a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1745 microversion: 2.20 time: 0.160911 May 11 06:04:26.609238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 483/963] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:26 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:27.626420 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:27.627028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:27.633280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:27.633757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:27.634519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:27.634956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:27.760089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:27.768663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:27.770203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:27.771355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f6923fcc-4ea1-4d8d-bf51-d8249268eef4 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1745 microversion: 2.20 time: 0.148874 May 11 06:04:27.771906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 481/964] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:27 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:28.789984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:28.790543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:28.797548 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:28.798004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:28.798783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:28.799225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:28.927630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:28.935636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:28.937149 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:28.938403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fe615ca3-2495-4492-9e3d-145b3c2b16ef tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1745 microversion: 2.20 time: 0.152418 May 11 06:04:28.938978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 484/965] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:28 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:29.957036 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:29.957611 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:29.963902 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:29.964346 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:29.965740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:29.966201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:30.097280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:30.105180 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:30.107050 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:30.108216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d9ac9f1b-7593-4df4-a7a1-291cb61d94f3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1745 microversion: 2.20 time: 0.155423 May 11 06:04:30.108812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 482/966] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:29 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:31.127148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:31.127792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:31.146354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:31.147120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:31.147932 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:31.148350 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:31.323133 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:31.332440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:31.334457 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:31.337648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-91824cea-36db-4002-b585-92eedf5a724c tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.214433 May 11 06:04:31.338421 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 485/967] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:31 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:32.358498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:32.359863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:32.366762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:32.367574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:32.368738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:32.369409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:32.456322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-e11ae602-17c1-4e97-87ef-c56eee87920c req-ded2a091-1bc2-4832-8dd9-4efbc3755169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "name": "network-vif-plugged", "status": "completed", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:32.475361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-e11ae602-17c1-4e97-87ef-c56eee87920c req-ded2a091-1bc2-4832-8dd9-4efbc3755169 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:32.475867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-e11ae602-17c1-4e97-87ef-c56eee87920c req-ded2a091-1bc2-4832-8dd9-4efbc3755169 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:32.488007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-e11ae602-17c1-4e97-87ef-c56eee87920c req-ded2a091-1bc2-4832-8dd9-4efbc3755169 service nova] Creating event network-vif-plugged:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:04:32.493573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-e11ae602-17c1-4e97-87ef-c56eee87920c req-ded2a091-1bc2-4832-8dd9-4efbc3755169 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 May 11 06:04:32.494497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 486/968] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:04:32.529819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:32.544886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:32.546541 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:32.547737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1b375470-1718-46b5-b75a-f205abc2e0dc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.193954 May 11 06:04:32.548298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 483/969] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:32 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:33.567119 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:33.567828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:33.574860 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:33.575595 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:33.576279 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:33.576667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:33.725878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:33.752897 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:33.754805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:33.756137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-60181301-cdd6-4758-8a9b-792bc6ba3c12 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.193919 May 11 06:04:33.759550 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 487/970] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:33 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:34.792298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:34.793804 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:34.801042 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:34.801666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:34.802585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:34.803199 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:34.946203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:34.955386 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:34.957211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:34.958403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-291bbb02-535d-43ee-a9c3-139e848711f0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.170238 May 11 06:04:34.959137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 484/971] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:34 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:35.977130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:35.977885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:35.984362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:35.984825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:35.985630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:35.986243 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:36.147802 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:36.157012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:36.158695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:36.160033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-48b5ab5b-64fc-4b7f-97b5-6b68f92a26b3 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.186777 May 11 06:04:36.161031 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 488/972] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:35 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:37.186852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:37.187775 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:37.194456 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:37.194986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:37.195829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:37.196325 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:37.344007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:37.352980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:37.354692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:37.356566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-57421e2a-e945-4895-8d92-4b9a39f42142 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.178652 May 11 06:04:37.370889 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 485/973] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:37 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:38.376294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:38.377624 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:38.384626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:38.385176 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:38.386183 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:38.386562 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:38.541534 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:38.550572 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:38.552719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:38.554191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-19bce34f-83ef-4e49-96b9-559671a44c28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.181745 May 11 06:04:38.554949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 489/974] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:38 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:39.572729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:39.573258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:39.580332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:39.581057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:39.582112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:39.582766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:39.737353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:39.745980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:39.748503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:39.749946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2a6df7ec-a257-4bb0-b8d5-69365e456d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1740 microversion: 2.20 time: 0.181257 May 11 06:04:39.750694 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 486/975] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:39 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:40.768295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:40.769061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:40.775222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:40.775956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:40.776842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:40.778090 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:40.913587 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:40.922594 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:40.924441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:40.925653 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fd252577-62fe-4525-a8aa-9d64d29e7c31 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1722 microversion: 2.20 time: 0.161561 May 11 06:04:40.926528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 490/976] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:40 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:41.673623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:41.674109 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:41.680496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:41.680948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:41.681755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:41.682195 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:41.709651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-90292fa8-7814-4a15-bb5f-f20f639ab9ba tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/ips" status: 200 len: 145 microversion: 2.1 time: 0.039943 May 11 06:04:41.710220 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 487/977] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:04:41 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:41.944297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:41.944978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:41.966440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:41.966739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:41.967568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:41.968012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:42.107025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:42.114931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:42.116422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:42.117619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7ca25266-14c2-4631-ab97-97ecd3dacfa8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1722 microversion: 2.20 time: 0.177451 May 11 06:04:42.118227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 491/978] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:41 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:43.044427 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56d4a94e-52ac-4f3d-9ad1-7983192aaec8"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:43.045871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:43.053089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:43.053602 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:43.054403 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:43.054839 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:43.139688 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:43.140304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:43.146955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:43.147402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:43.148175 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:43.148606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:43.286171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:43.296988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:43.298650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:43.299937 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5898fd9e-34d5-41cb-8faa-3af076106766 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1722 microversion: 2.20 time: 0.167558 May 11 06:04:43.300589 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 492/979] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:43 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:43.403963 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fa96ba2f-8d85-4f68-a22f-8da623c72029 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364703 May 11 06:04:43.404600 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 488/980] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:04:43 2022] POST /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:44.318887 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:44.319518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:44.325916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.326371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.327151 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.327594 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.392402 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-b23e9257-a38a-45ae-9ef1-9f75de03f9d7 req-dcd490d2-a28c-4d43-a7a1-b00f13a70232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "name": "network-vif-unplugged", "status": "completed", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:44.403229 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-b23e9257-a38a-45ae-9ef1-9f75de03f9d7 req-dcd490d2-a28c-4d43-a7a1-b00f13a70232 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.404566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-b23e9257-a38a-45ae-9ef1-9f75de03f9d7 req-dcd490d2-a28c-4d43-a7a1-b00f13a70232 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.416338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.compute.server_external_events [req-b23e9257-a38a-45ae-9ef1-9f75de03f9d7 req-dcd490d2-a28c-4d43-a7a1-b00f13a70232 service nova] Unable to find a host for instance 5020c511-6684-4f25-8d07-840612e810f0. Dropping event network-vif-unplugged {{(pid=117335) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 06:04:44.417609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-b23e9257-a38a-45ae-9ef1-9f75de03f9d7 req-dcd490d2-a28c-4d43-a7a1-b00f13a70232 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030069 May 11 06:04:44.419247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 489/981] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 11 06:04:44.482034 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:44.492104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:44.494077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:44.495568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-242a8c8f-b03e-4ebb-b534-1dcc23090739 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1665 microversion: 2.20 time: 0.180599 May 11 06:04:44.496462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 493/982] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:44 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:04:44.513688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c824082-b04d-448e-8109-a55e3d87132f"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:44.514862 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:44.521053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.521534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.522302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.522740 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.801990 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f9f719c4-c466-454c-bb16-08f5c7485d8a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292347 May 11 06:04:44.802637 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 490/983] 10.222.0.44 () {62 vars in 1363 bytes} [Wed May 11 06:04:44 2022] POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 06:04:44.929869 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:44.930387 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:44.936721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.937179 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:44.937997 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:44.938447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:45.178480 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-04b478de-2183-47a2-8e93-d19f976bece5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments/8c824082-b04d-448e-8109-a55e3d87132f" status: 202 len: 0 microversion: 2.20 time: 0.252751 May 11 06:04:45.179092 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 494/984] 10.222.0.44 () {60 vars in 1456 bytes} [Wed May 11 06:04:44 2022] DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments/8c824082-b04d-448e-8109-a55e3d87132f => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:04:45.235150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:45.235965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:45.242221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:45.242662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:45.243466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:45.243852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:45.428818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-18db1848-5a1c-40f9-9328-a95e59328962 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/action" status: 202 len: 0 microversion: 2.20 time: 0.197658 May 11 06:04:45.429575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 491/985] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 06:04:45 2022] POST /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 06:04:45.438645 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:45.439892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:45.445987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:45.446444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:45.447225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:45.447667 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:45.622522 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:45.630778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:45.632335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:45.635335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c9b42cd4-c499-46eb-b75e-d86a0acedb46 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1673 microversion: 2.20 time: 0.199321 May 11 06:04:45.635948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 495/986] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:45 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:46.655895 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:46.656492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:46.663701 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:46.664245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:46.665106 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:46.665583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:46.891569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:46.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:46.900924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:46.902288 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-821a5c07-1f4e-481a-82d5-65bb27093d3b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.250987 May 11 06:04:46.903116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 492/987] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:46 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:47.921523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:47.923202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:47.934681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:47.935504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:47.936348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:47.936745 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:48.103730 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:48.113784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:48.115315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:48.116516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5f70ed75-b8b5-48fe-960d-2ed0b68dbd28 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.200091 May 11 06:04:48.117078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 496/988] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:47 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:49.135776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:49.136557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:49.144936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:49.145497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:49.146500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:49.147008 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:49.299893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:49.309001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:49.311801 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:49.313774 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4a59735d-eba7-4537-966d-d852364ae44e tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.181762 May 11 06:04:49.314968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 493/989] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:49 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:50.332384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:50.333048 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:50.339476 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:50.339935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:50.341358 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:50.341819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:50.488675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:50.496749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:50.498334 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:50.499528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-860c9fa4-9643-4be6-a115-4fe269c70fe2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.171188 May 11 06:04:50.501361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 497/990] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:50 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:51.517218 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:51.517984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:51.525395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:51.525872 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:51.526794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:51.527230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:51.681999 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:51.692688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:51.694534 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:51.695703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-700f7e52-b805-44fd-b53c-028fa5a857f7 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.182734 May 11 06:04:51.706137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 494/991] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:51 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:52.724458 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:52.725248 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:52.732909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:52.733361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:52.734172 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:52.734615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:52.877294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:52.888799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:52.890764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:52.892186 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f2baeafb-c2da-48a9-95a9-6c9db590f291 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.171779 May 11 06:04:52.893152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 498/992] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:52 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:53.916673 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:53.917759 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:53.925960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:53.926483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:53.927487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:53.927978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:54.081133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:54.089199 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:54.091603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:54.092655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-949d500b-6011-46ba-a765-aab229ff2506 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.184581 May 11 06:04:54.097757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 495/993] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:53 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:55.062891 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:55.063477 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:55.070073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:55.070565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:55.071354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:55.071815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:55.097863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-30b7225e-2ec3-4603-b8be-b02610927258 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/ips" status: 200 len: 149 microversion: 2.1 time: 0.039205 May 11 06:04:55.103777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 499/994] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:04:55 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:55.111023 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:55.111648 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:55.118329 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:55.119078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:55.120269 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:55.121039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:55.297016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:55.311926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:55.313432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:55.314819 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4e91a679-9975-4c90-a152-db3c58f3dea5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.207853 May 11 06:04:55.315692 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 496/995] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:55 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:56.332697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:56.333309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:56.339670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:56.340850 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:56.341660 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:56.342101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:56.470551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:56.478287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:56.479809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:56.481686 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2de4064d-2ac6-4554-9c85-833a0c7b5406 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.152193 May 11 06:04:56.482258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 500/996] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:56 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:04:56.534498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c19cc51-c989-4924-a5c4-6a835d61ed13"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:04:56.535633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:56.541971 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:56.542423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:56.543212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:56.544800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:57.499953 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:57.500646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:57.506974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:57.507427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:57.508205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:57.508648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:57.636387 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:57.645051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:57.646647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:57.647807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-11b687e9-e7b8-44cb-b134-e9129e50abde tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.151912 May 11 06:04:57.648366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 501/997] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:57 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:04:58.665780 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:58.666481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:58.672969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:58.673428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:58.674226 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:58.674691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:58.799109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:58.806894 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:58.808430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:58.810217 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6652ab2b-5485-48bb-8f57-fb342ad71bca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.148391 May 11 06:04:58.810783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 502/998] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:58 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:04:59.015864 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e7af5ffd-c325-44ae-9e7d-a6488dc799e3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "POST /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.484785 May 11 06:04:59.016643 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 497/999] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:04:56 2022] POST /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 194 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:04:59.828980 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:04:59.829972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:04:59.836647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:59.837109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:59.838023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:04:59.838470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:04:59.971656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:59.979482 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:59.981073 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:04:59.982389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-90d5c77d-406a-4154-99bc-351b4d66bad8 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.157867 May 11 06:04:59.982955 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 503/1000] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:04:59 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:00.444887 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:00.445993 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:00.452782 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:00.453362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:00.454179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:00.454647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:00.485773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7aea4b21-f20f-4663-b359-7ab0142c38bf tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 May 11 06:05:00.486765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 498/1001] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:00 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:00.496423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:00.497050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:00.504521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:00.505060 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:00.506047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:00.506495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:00.696015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-017d5d84-47fd-45ba-a7bc-789a4d489382 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8" status: 200 len: 194 microversion: 2.1 time: 0.203714 May 11 06:05:00.696778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 504/1002] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 06:05:00 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8 => generated 194 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:01.001422 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:01.002083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:01.008702 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:01.009164 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:01.010051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:01.010493 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:01.142578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:01.150438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:01.151945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:01.153133 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1e4368f1-a56b-45ac-864b-c0194944db0b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.156644 May 11 06:05:01.153727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 499/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:00 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:02.031238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f87828cd-be2e-419f-8dce-cdb4d67ba3d7"}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:02.032329 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:02.038618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:02.039078 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:02.039855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:02.040312 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:02.172421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:02.173136 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:02.181931 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:02.182842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:02.183708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:02.184307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:02.322530 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a63fa573-af01-46e7-a71a-36577bc58103 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "POST /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295646 May 11 06:05:02.328606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 505/1004] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 06:05:02 2022] POST /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:02.392251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:02.400806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:02.402356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:02.403526 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-3078db01-003f-4cdb-b818-d8c31cd3bd45 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.236275 May 11 06:05:02.404263 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 500/1005] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:02 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:05:02.500957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-9a58c0f4-3f2e-4117-8a34-20a08cc12b82 req-7675521f-0fd1-403f-b582-42d63512543f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "name": "network-vif-plugged", "status": "completed", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:02.511210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-9a58c0f4-3f2e-4117-8a34-20a08cc12b82 req-7675521f-0fd1-403f-b582-42d63512543f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:02.511905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-9a58c0f4-3f2e-4117-8a34-20a08cc12b82 req-7675521f-0fd1-403f-b582-42d63512543f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:02.524187 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-9a58c0f4-3f2e-4117-8a34-20a08cc12b82 req-7675521f-0fd1-403f-b582-42d63512543f service nova] Creating event network-vif-plugged:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:05:02.530035 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-9a58c0f4-3f2e-4117-8a34-20a08cc12b82 req-7675521f-0fd1-403f-b582-42d63512543f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033510 May 11 06:05:02.530967 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 506/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:03.423603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:03.424225 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:03.430860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:03.431338 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:03.432117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:03.432557 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:03.568588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:03.577419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:03.579000 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:03.580173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7c557748-2a54-4b5d-9ef3-1130a847c3b5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.161333 May 11 06:05:03.580744 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 501/1007] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:03 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:04.599601 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:04.600627 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:04.606893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.607403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:04.608964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.609561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:04.729250 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:04.729814 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:04.736838 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.737529 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:04.738466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.739088 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:04.753338 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:04.763289 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:04.763780 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lazy-loading 'flavor' on Instance uuid 83fc7441-7d03-47f5-b466-96344add4ec3 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:04.767431 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:04.769328 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-92ca08fe-ddea-410f-bdee-f2646075c68a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1731 microversion: 2.20 time: 0.174328 May 11 06:05:04.770657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 507/1008] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:04 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:04.854918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-27dc0b18-e766-43e8-ad10-641cb7d5044c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "POST /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3/action" status: 202 len: 0 microversion: 2.1 time: 0.129297 May 11 06:05:04.855823 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 502/1009] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:05:04 2022] POST /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:05:04.865717 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:04.866956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:04.879015 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.879640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:04.880777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:04.881565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:05.073027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:05.081760 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-bf3e8b0f-b5cb-493c-8e91-cebcbcd11071 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.220489 May 11 06:05:05.082427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 508/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:04 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:05.788883 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:05.789513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:05.795943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:05.796570 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:05.797546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:05.798011 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:05.957631 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:05.966440 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:05.968725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:05.969943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e8b1e841-8d43-43c7-9700-d2d771ae3e98 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1718 microversion: 2.20 time: 0.186000 May 11 06:05:05.970506 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 503/1011] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:05 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:06.105499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:06.106561 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:06.113206 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.113692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.114473 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.114909 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.270225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:06.279977 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-447468fd-6111-4548-ab59-a45776725640 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.183968 May 11 06:05:06.280613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 509/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:06 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:06.660094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:06.660619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:06.666776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.667154 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.667918 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.668353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.747522 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lazy-loading 'services' on Instance uuid 0f4fc3fd-bfef-4724-bf48-e90b015479bb {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:06.819501 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-aa942839-e4d4-4df3-a069-f7309c10b28d tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments/1c19cc51-c989-4924-a5c4-6a835d61ed13" status: 202 len: 0 microversion: 2.1 time: 0.165151 May 11 06:05:06.820095 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 504/1013] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:05:06 2022] DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments/1c19cc51-c989-4924-a5c4-6a835d61ed13 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:05:06.828482 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:06.829946 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:06.835874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.836213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.837072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:06.837569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:06.870428 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e3e9b4a8-3f5e-4b40-9e72-71dc333caa8a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045907 May 11 06:05:06.870993 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 510/1014] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:06 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:07.298574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:07.299266 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:07.305423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:07.305893 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:07.306656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:07.307083 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:07.443319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:07.450749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b2f0f2a7-91aa-4149-a7cd-3144212af41b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.156419 May 11 06:05:07.451321 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 505/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:07 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:07.882564 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:07.883467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:07.889865 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:07.890313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:07.891332 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:07.891768 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:07.920799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d8d67dce-fc22-4e0c-8b5d-239cf7826393 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 May 11 06:05:07.921345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 511/1016] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:07 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:08.467334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:08.467882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:08.474232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:08.474683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:08.475450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:08.475885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:08.613689 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:08.621097 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f4ba7b03-b7ab-440b-9fda-472ec40421d5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.158006 May 11 06:05:08.621700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 506/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:08 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:08.934639 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:08.936629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:08.943583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:08.944029 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:08.944795 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:08.945231 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:08.976789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4e7baa44-447a-4c4f-9b45-dedf083cf618 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048386 May 11 06:05:08.977349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 512/1018] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:08 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:09.638685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:09.639296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:09.645868 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:09.646542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:09.647478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:09.647924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:09.784854 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:09.792328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ae0b4684-97c7-4dfe-a414-b73497e8ede5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.157506 May 11 06:05:09.792896 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 507/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:09 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:09.989011 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:09.989964 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:09.996286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:09.996737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:09.997536 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:09.998523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:10.028803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d48008af-b703-4813-bbf2-22d7fec61588 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 May 11 06:05:10.029705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 513/1020] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:09 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:10.809326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:10.809978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:10.816710 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:10.817124 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:10.818098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:10.818662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:10.954853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:10.963130 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0bfb3b6d-9e6b-4b23-b018-74a3749539c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.157571 May 11 06:05:10.963930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 508/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:10 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:11.041754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:11.042695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:11.049166 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:11.049666 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:11.050443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:11.050886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:11.080341 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-97e88b36-7153-4069-b3d5-45af72cb6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 May 11 06:05:11.080822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 514/1022] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:11 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:11.982749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:11.983680 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:11.991071 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:11.991523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:11.992295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:11.992733 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:12.094790 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:12.095732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:12.102289 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:12.102755 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:12.103543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:12.103986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:12.127919 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:12.135596 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4e482f08-3118-44fa-8055-5b4923559d9a tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.158181 May 11 06:05:12.136310 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 509/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:11 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:12.136777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-faae8762-a6ea-4da1-803d-c30ced79b966 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047904 May 11 06:05:12.137427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 515/1024] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:12 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:13.149404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:13.150332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:13.151969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:13.152552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:13.156821 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:13.157272 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:13.158070 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:13.158507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:13.159579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:13.160036 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:13.160815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:13.161254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:13.190167 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5256b6c4-978b-440f-ab0c-bf651519987c tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 May 11 06:05:13.190743 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 510/1025] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:13 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:13.301449 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:13.311322 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-472fba78-304a-45c6-8ac7-6a66a96b5c96 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.163130 May 11 06:05:13.311933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 516/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:13 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:14.202010 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:14.202898 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:14.209318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:14.209811 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:14.210581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:14.211016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:14.240810 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-642a2bd7-1670-43ae-8cdd-3237244bb366 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 May 11 06:05:14.241381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 511/1027] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:14 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:14.330353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:14.330974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:14.337547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:14.338019 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:14.338811 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:14.339354 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:14.478446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:14.485983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f5c385af-80d7-42ac-80a5-0a34d25c0b73 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.160463 May 11 06:05:14.486569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 517/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:14 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:15.252366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:15.253301 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:15.259728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:15.260178 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:15.260954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:15.261394 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:15.291358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4f7f39ee-cd22-4942-b4d3-77abbc4b4319 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043019 May 11 06:05:15.291930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 512/1029] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:15 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:15.503205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:15.503829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:15.510230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:15.510687 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:15.511469 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:15.511911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:15.648115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:15.655962 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-03d6efac-dc7f-4a2f-9bf0-c043751ca2f6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.156748 May 11 06:05:15.656525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 518/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:15 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:16.304572 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:16.305536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:16.312459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:16.312926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:16.313745 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:16.314189 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:16.344627 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b8ca63a9-d63b-4c92-a706-131aebd4b647 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 May 11 06:05:16.345282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 513/1031] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:16 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:16.675014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:16.675569 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:16.681895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:16.682357 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:16.683128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:16.683568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:16.811079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:16.818443 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8b9b3b94-e675-4a3d-9652-630bb931f86f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.147460 May 11 06:05:16.819006 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 519/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:16 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:17.356362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:17.357451 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:17.363885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:17.364330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:17.365096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:17.365562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:17.397696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b80c1b75-b89e-4ec8-8a25-b47caf74972e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 May 11 06:05:17.398404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 514/1033] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:17 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:17.835311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:17.835934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:17.842280 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:17.842739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:17.843515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:17.843957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:17.973552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:17.981165 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-044cdeb3-23c0-4d21-81a5-f52b8167ccd9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.149737 May 11 06:05:17.981764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 520/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:17 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:18.408850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:18.409769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:18.416067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:18.416513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:18.417278 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:18.417739 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:18.447290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0b257577-f87c-4c19-8315-678249c22dab tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042434 May 11 06:05:18.447842 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 515/1035] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:18 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:18.999205 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:18.999823 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:19.006245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:19.006702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:19.007472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:19.007910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:19.134811 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:19.143058 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-359963e8-d1c9-4b7d-9cfc-829edda3a807 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.148347 May 11 06:05:19.143625 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 521/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:18 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:19.458485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:19.459466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:19.465982 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:19.466434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:19.467260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:19.467988 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:19.497587 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4ff55f93-6d5e-4cd0-beda-806bc316c376 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043222 May 11 06:05:19.498156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 516/1037] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:19 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:20.161178 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:20.161829 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:20.168050 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:20.168499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:20.169266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:20.169759 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:20.304230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:20.312523 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-069620c8-4937-433c-865b-7b9e964726c7 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.155160 May 11 06:05:20.313085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 522/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:20 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:20.509848 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:20.510986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:20.519523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:20.520327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:20.521176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:20.521941 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:20.554125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-45a60c51-6221-4b24-ba7a-698e0dd28df2 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048144 May 11 06:05:20.554802 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 517/1039] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:20 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:21.329614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:21.330236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:21.338297 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.338789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.339590 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.340037 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.424296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:21.425219 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:21.431138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.431588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.432387 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.432824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.462989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-08f93ee8-d622-4a3e-820c-282c6652e76d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043168 May 11 06:05:21.463558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 518/1040] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:21 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:21.481665 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:21.489059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-840b0f14-e2ac-4e69-9de8-7fc1057dd0fb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.163463 May 11 06:05:21.489636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 523/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:21 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:21.566009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:21.566941 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:21.573450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.573942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.574711 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.575149 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.605699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d2e54e32-1cf5-4a8c-b678-8d38c5838af1 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 May 11 06:05:21.606094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 519/1042] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:21 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:21.611529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:21.612131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:21.618715 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.619213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.620199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.620647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.651950 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-027a8965-5cd6-4756-90f7-dfd41c25640a tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8" status: 200 len: 194 microversion: 2.1 time: 0.044440 May 11 06:05:21.652570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 524/1043] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 06:05:21 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:21.662850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:21.663349 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:21.669232 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.669721 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.670518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:21.670980 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:21.749865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lazy-loading 'services' on Instance uuid 0b347d8e-b37a-4081-834a-c25569880ac3 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:21.821489 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-47b86d4d-46b7-4ba2-9b1f-2e93085b3bfc tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8" status: 202 len: 0 microversion: 2.1 time: 0.162304 May 11 06:05:21.822085 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 520/1044] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:05:21 2022] DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/56d4a94e-52ac-4f3d-9ad1-7983192aaec8 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:05:22.506620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:22.507325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:22.514055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:22.514641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:22.515684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:22.516128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:22.618392 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:22.619404 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:22.625519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:22.625969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:22.626736 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:22.627179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:22.649671 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:22.660473 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c09fe57a-6b62-4eff-a108-edf84d1aa462 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.157999 May 11 06:05:22.661014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca567b72-0815-4f4d-9e80-8d44d6095fa4 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 May 11 06:05:22.661238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 525/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:22 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:22.664768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 521/1046] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:22 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:23.672783 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:23.674302 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:23.678562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:23.679245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:23.680741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.681323 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.682211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.682648 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.687728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.688127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.689035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.689496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.721324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-31365d37-9479-4c3c-bfbe-82fc3f746df5 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052852 May 11 06:05:23.722340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 526/1047] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:23 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 06:05:23.794733 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:23.795892 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:23.804227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.804928 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.805913 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.806512 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.835751 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:05:23.873013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:23.882003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4ecb6b62-f9de-4a7b-9e99-2271c90f9f6c tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.207679 May 11 06:05:23.892239 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 522/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:23 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:23.916929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-00fe3131-bd70-4fdd-aa1f-8e3fd1bf6c18 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 204 len: 0 microversion: 2.1 time: 0.131557 May 11 06:05:23.917437 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 527/1049] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:23 2022] DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 06:05:23.926570 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:23.927296 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:23.934060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.934533 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:23.935317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:23.936341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:24.075188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:24.088098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-125c3af0-af5c-4c95-afc0-49e10a8cd5cc tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1681 microversion: 2.1 time: 0.165568 May 11 06:05:24.089254 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 523/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:23 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:24.900940 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:24.901692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:24.908366 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:24.908834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:24.909684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:24.910130 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.103528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:25.106555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:25.107176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:25.115713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1745bc3f-3ffa-4815-98ac-f220c4c0d519 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.219070 May 11 06:05:25.118908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 528/1051] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:24 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:25.119836 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.120549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.121444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.124563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.182533 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:25.183150 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:25.189556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.190014 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.190805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.191242 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.224292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7ac0cc5c-0bac-4094-a015-d118ff279b0f tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/f87828cd-be2e-419f-8dce-cdb4d67ba3d7" status: 200 len: 194 microversion: 2.1 time: 0.046033 May 11 06:05:25.224819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 529/1052] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 06:05:25 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/f87828cd-be2e-419f-8dce-cdb4d67ba3d7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:25.234720 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:25.235224 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:25.241399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.241884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.242673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:25.243114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:25.330389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lazy-loading 'services' on Instance uuid 0b347d8e-b37a-4081-834a-c25569880ac3 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:25.422133 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-02d312ca-da8c-4c6c-8e79-b1827a15116c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/f87828cd-be2e-419f-8dce-cdb4d67ba3d7" status: 202 len: 0 microversion: 2.1 time: 0.191010 May 11 06:05:25.427333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 530/1053] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 06:05:25 2022] DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments/f87828cd-be2e-419f-8dce-cdb4d67ba3d7 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:05:25.589526 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:25.597502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2861ecda-ae18-4cc8-a043-203e815722ff tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1681 microversion: 2.1 time: 0.494801 May 11 06:05:25.598141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 524/1054] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:25 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1681 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:26.138872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:26.139773 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:26.157754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.157754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.157754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.157754 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.303614 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:26.311546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3b7ad4fa-29a5-4cea-9881-75b97a48a490 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1569 microversion: 2.1 time: 0.178679 May 11 06:05:26.312112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 531/1055] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:26 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:26.327752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:26.328356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:26.334763 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.335214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.335983 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.336423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.429573 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8db40374-db9a-4712-b7e5-3c8db68ce915 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "POST /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3/action" status: 202 len: 0 microversion: 2.1 time: 0.105759 May 11 06:05:26.430167 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 525/1056] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 06:05:26 2022] POST /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:05:26.438091 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:26.438839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:26.444873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.445441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.446359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.446910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.598532 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:26.606081 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4fe3a7e0-6bd4-4d93-ab3a-d771a00cd7b2 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1577 microversion: 2.1 time: 0.171827 May 11 06:05:26.607041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 532/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:26 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:26.614973 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:26.615833 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:26.622174 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.622729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.623885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:26.624366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:26.886967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:26.907020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-046df600-4a4f-420c-9b11-699f167576ba tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1681 microversion: 2.1 time: 0.295949 May 11 06:05:26.907832 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 526/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:26 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:27.360268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-eac42e59-1b80-4d75-bb5f-dfccea8906d2 req-e8fac751-1fdf-42d1-a160-c4b46cce9bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f4fc3fd-bfef-4724-bf48-e90b015479bb", "name": "network-vif-deleted", "tag": "17f47768-2a4d-42ae-a06d-f30c25c57200"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:27.369098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-eac42e59-1b80-4d75-bb5f-dfccea8906d2 req-e8fac751-1fdf-42d1-a160-c4b46cce9bad service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:27.369651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-eac42e59-1b80-4d75-bb5f-dfccea8906d2 req-e8fac751-1fdf-42d1-a160-c4b46cce9bad service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:27.381970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-eac42e59-1b80-4d75-bb5f-dfccea8906d2 req-e8fac751-1fdf-42d1-a160-c4b46cce9bad service nova] Creating event network-vif-deleted:17f47768-2a4d-42ae-a06d-f30c25c57200 for instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb on hv-cinder-73362 May 11 06:05:27.387351 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-eac42e59-1b80-4d75-bb5f-dfccea8906d2 req-e8fac751-1fdf-42d1-a160-c4b46cce9bad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031054 May 11 06:05:27.388347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 533/1059] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:27.625075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:27.625937 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:27.632519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:27.633068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:27.633949 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:27.634450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:27.770028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:27.777943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bd15e9a7-15c9-4b72-bddb-0183e9da486f tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1517 microversion: 2.1 time: 0.157650 May 11 06:05:27.778518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 527/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:27 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:27.924584 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:27.925389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:27.932098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:27.932551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:27.933318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:27.933786 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:27.997770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:28.005661 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c88fb6f4-4405-49f7-a9f1-4675ae5d4038 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1614 microversion: 2.1 time: 0.085403 May 11 06:05:28.006232 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 534/1061] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:27 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:28.142255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-62311b09-2da9-4099-a3ae-56f3d19c780d req-d3f2ec68-c5e0-4de1-87d6-90420c4d5618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "name": "network-vif-unplugged", "status": "completed", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:28.150860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-62311b09-2da9-4099-a3ae-56f3d19c780d req-d3f2ec68-c5e0-4de1-87d6-90420c4d5618 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:28.151863 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-62311b09-2da9-4099-a3ae-56f3d19c780d req-d3f2ec68-c5e0-4de1-87d6-90420c4d5618 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:28.169387 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.compute.server_external_events [req-62311b09-2da9-4099-a3ae-56f3d19c780d req-d3f2ec68-c5e0-4de1-87d6-90420c4d5618 service nova] Unable to find a host for instance 83fc7441-7d03-47f5-b466-96344add4ec3. Dropping event network-vif-unplugged {{(pid=117335) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 11 06:05:28.170907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-62311b09-2da9-4099-a3ae-56f3d19c780d req-d3f2ec68-c5e0-4de1-87d6-90420c4d5618 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033392 May 11 06:05:28.171509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 528/1062] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 11 06:05:28.795659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:28.796277 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:28.802632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:28.803085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:28.803847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:28.804280 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:28.932194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:28.940762 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-855fe3b0-7194-4349-a0b3-0e725d220642 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1517 microversion: 2.1 time: 0.149067 May 11 06:05:28.941340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 535/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:28 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1517 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:29.023442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:29.024068 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:29.031051 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.031512 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.032293 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.032735 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.105332 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892d58f399a44b485514cb29f2259b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34db399b717b42f18c5190acb605918f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:29.114022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5614ce04-b271-4da4-b877-67fff804f259 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 200 len: 1327 microversion: 2.1 time: 0.094429 May 11 06:05:29.118683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 529/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:29 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:29.628021 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-752019636", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "networks": [{"uuid": "63a19bd2-5787-45d5-8224-96cb62668c41"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:29.703053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] validate_networks() for [('63a19bd2-5787-45d5-8224-96cb62668c41', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:05:29.792091 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:29.793030 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:29.799654 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.800107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.800909 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.801336 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.830380 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-915a516e-f532-4161-a8d9-8dc5dcadd35d tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042370 May 11 06:05:29.830948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 530/1065] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:29 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:05:29.934190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:29.935165 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:29.941179 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.941750 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.942591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.943122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.974797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-553aa0f9-71d3-431e-9070-61806bb37f98 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044560 May 11 06:05:29.975625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 531/1066] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 06:05:29 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 11 06:05:29.980435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:29.981059 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:29.987517 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.987972 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:29.988888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:29.989176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.062025 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:05:30.062518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:05:30.063051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:05:30.063571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:05:30.064053 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:05:30.073261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.073743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.074551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.075163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.092807 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Getting quotas for project a40603d2f46d4ad2986e9277a47a8211. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:05:30.096927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Getting quotas for user 34e24c80364642b083dc32697f7320ad and project a40603d2f46d4ad2986e9277a47a8211. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:05:30.108380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:05:30.110664 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:05:30.119688 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:30.127796 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-330909d2-b651-4c56-91b9-676e6c6f26d8 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1519 microversion: 2.1 time: 0.151022 May 11 06:05:30.128375 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 532/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:29 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:30.132777 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:30.133277 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:30.139190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.139725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.140928 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.141454 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.159169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f8cdc123-8ab4-4551-84e5-a1666fd65420 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535857 May 11 06:05:30.160110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 536/1068] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:05:30.166670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:30.167359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:30.175007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:05:30.180026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.180580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.181879 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.182777 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.197545 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb HTTP/1.1 May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:30.199386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:30.200957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '0f4fc3fd-bfef-4724-bf48-e90b015479bb'} May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:30.202464 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:30.206121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:30.209547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:30.209547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a0f526c3-afd3-4f3e-a5e9-e801a4e44fce tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 404 len: 111 microversion: 2.1 time: 0.039974 May 11 06:05:30.209547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 537/1069] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:30 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:30.209547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-03e84e98-b641-4550-aa1e-e28d883baab6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:30.209547 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-03e84e98-b641-4550-aa1e-e28d883baab6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:30.268751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cf09f7ed-5bd8-42c2-ae06-9c6f558abd0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 204 len: 0 microversion: 2.1 time: 0.138964 May 11 06:05:30.269326 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-03e84e98-b641-4550-aa1e-e28d883baab6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:30.270006 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 533/1070] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:30 2022] DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:05:30.276244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-03e84e98-b641-4550-aa1e-e28d883baab6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1213 microversion: 2.1 time: 0.073563 May 11 06:05:30.276808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 538/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:30 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:30.278483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5106998f-ae8c-46c4-8e25-074f56494e0e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '.version_select at 0x7fa1401e2160>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:30.284843 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:30.285465 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:30.292287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.293157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.294182 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:30.295601 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:30.307357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5106998f-ae8c-46c4-8e25-074f56494e0e tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564856824" status: 202 len: 0 microversion: 2.1 time: 0.035929 May 11 06:05:30.308101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 534/1072] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 06:05:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564856824 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:05:30.486620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:30.495384 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ce2bfc69-7fb0-41fd-859f-955ea245d6f8 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1673 microversion: 2.1 time: 0.214699 May 11 06:05:30.496210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 539/1073] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:30 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:31.146061 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:31.146798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:31.152544 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.152998 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.153797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.154277 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.284137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:31.291528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8575db44-fb27-4401-8262-059be7087f03 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1519 microversion: 2.1 time: 0.149835 May 11 06:05:31.292096 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 535/1074] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:31 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:31.298654 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:31.299364 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:31.305893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.306362 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.307123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.307563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.371700 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:31.379665 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ad4c5ccb-5522-4786-9c3c-070fd4382f6e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1217 microversion: 2.1 time: 0.085557 May 11 06:05:31.380237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 540/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:31 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:31.511970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:31.512588 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:31.518818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.519258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.520015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:31.520449 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:31.644981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:31.653428 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2c3ed967-269d-4c83-b52f-17115cbaec06 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1673 microversion: 2.1 time: 0.145154 May 11 06:05:31.654027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 536/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:31 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:32.309328 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:32.309990 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:32.317059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.317535 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.318320 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.318764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.396794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:32.397458 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:32.404116 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.404578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.405661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.406240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.463805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:32.471723 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-93a46dcb-2095-40c9-86bd-f96571026734 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1519 microversion: 2.1 time: 0.166211 May 11 06:05:32.472304 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 541/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:32 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:32.477126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:32.486047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-22d4958d-173d-4bfa-9cca-c18157ffaf97 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1265 microversion: 2.1 time: 0.093235 May 11 06:05:32.486623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 537/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:32 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:32.671244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:32.671889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:32.677889 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.678344 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.679114 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:32.679580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:32.807506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:32.815441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-feaa8757-b491-466f-8ec2-935a19114b6b tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1673 microversion: 2.1 time: 0.148482 May 11 06:05:32.816673 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 542/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:32 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:32.872650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1454001741", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-860430622", "security_groups": [{"name": "tempest-secgroup-smoke-1626878111"}], "block_device_mapping_v2": [{"uuid": "4c3a94e3-941c-4b6a-916c-0ab6cf7fd69c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c2135e5-d24e-4b23-bdbc-168d1955897d"}]}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:33.025668 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.network.neutron [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] validate_networks() for [('1c2135e5-d24e-4b23-bdbc-168d1955897d', None, None, None, None, None)] {{(pid=117335) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:05:33.187698 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:33.188446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:33.198055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.198784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.199761 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.200363 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.223434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb HTTP/1.1 May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:33.225070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.226732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '0f4fc3fd-bfef-4724-bf48-e90b015479bb'} May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:33.227650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.229220 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.231482 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:33.232934 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-efa53cc1-1ed1-4e0c-afde-da9d286fb6d7 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 404 len: 111 microversion: 2.1 time: 0.050650 May 11 06:05:33.237079 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 543/1080] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:33 2022] DELETE /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:33.242061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:33.242684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 0f4fc3fd-bfef-4724-bf48-e90b015479bb] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:33.248690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.249148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.249972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.250409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.264059 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb HTTP/1.1 May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:33.266444 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.268070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '0f4fc3fd-bfef-4724-bf48-e90b015479bb'} May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:33.268910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. May 11 06:05:33.270423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:33.271691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 0f4fc3fd-bfef-4724-bf48-e90b015479bb could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:33.271691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-820b7f4c-6549-48ad-bf8c-2e756db7ef35 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb" status: 404 len: 111 microversion: 2.1 time: 0.029553 May 11 06:05:33.271691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 544/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:33 2022] GET /compute/v2.1/servers/0f4fc3fd-bfef-4724-bf48-e90b015479bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:33.488691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:33.493115 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:33.504745 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.505489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.506288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.506737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.695440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:33.705744 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-96299909-78d3-4436-88a5-508b9c2150a5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.221019 May 11 06:05:33.716251 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 545/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:33 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:33.722194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:33.722834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:33.729317 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.729929 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.730808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.731371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.823604 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:33.835573 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2091ce78-fd78-49a1-b173-b66868f877e6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1271 microversion: 2.1 time: 0.118124 May 11 06:05:33.836435 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 546/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:33 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:33.852294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:33.853567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:33.862432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.862904 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.863704 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.864679 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.894337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:05:33.894804 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image limits 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:05:33.895204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Flavor pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:05:33.895800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Image pref 0:0:0 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:05:33.896485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.virt.hardware [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117335) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:05:33.906595 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.909509 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.910518 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:33.911155 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:33.933063 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:05:33.938084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.quota [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Getting quotas for user bbc14e1f89334e65b24fec7b4a321c5d and project 12ba636dcfc34045b8b7fd82fa770bc0. Resources: {'instances', 'cores', 'ram'} {{(pid=117335) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:05:34.014416 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Going to run 1 instances... {{(pid=117335) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:05:34.018824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c3a94e3-941c-4b6a-916c-0ab6cf7fd69c',volume_size=None,volume_type=None)] {{(pid=117335) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:05:34.078926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:34.088450 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5cc3b068-a752-4645-ac62-180ae7e7e9b7 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1673 microversion: 2.1 time: 0.250422 May 11 06:05:34.090055 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 547/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:33 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1673 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:34.205070 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-b7017c1e-23c1-41a0-b2a9-18f41e36bfd4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.335776 May 11 06:05:34.210776 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 538/1085] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:05:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 06:05:34.216001 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-7e252b41-0f5a-4a0b-885d-7d32c8d8346d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.216622 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-7e252b41-0f5a-4a0b-885d-7d32c8d8346d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.312874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-7e252b41-0f5a-4a0b-885d-7d32c8d8346d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:34.320636 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-7e252b41-0f5a-4a0b-885d-7d32c8d8346d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1094 microversion: 2.1 time: 0.108461 May 11 06:05:34.321770 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 548/1086] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:34 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1094 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:34.413436 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.413911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.427428 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.429361 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.430542 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.431214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.449708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e HTTP/1.1 May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:34.452358 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.454035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '4efab7ed-d556-45bf-b471-e4783656823e'} May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:34.455053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.456364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.459265 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:34.460364 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c81fc0ca-fcda-4cd3-b16f-aee1907afcaa tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 404 len: 111 microversion: 2.1 time: 0.051053 May 11 06:05:34.464472 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 539/1087] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:34 2022] DELETE /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:34.470105 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.470806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 4efab7ed-d556-45bf-b471-e4783656823e] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.481708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.482173 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.483930 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.484553 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.502681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e HTTP/1.1 May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:34.505563 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.507202 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '4efab7ed-d556-45bf-b471-e4783656823e'} May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:34.508084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. May 11 06:05:34.509492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.511983 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 4efab7ed-d556-45bf-b471-e4783656823e could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:34.513229 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9898afb4-baf5-4a6f-8ae3-824eccd71f64 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e" status: 404 len: 111 microversion: 2.1 time: 0.047836 May 11 06:05:34.517402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 549/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:34 2022] GET /compute/v2.1/servers/4efab7ed-d556-45bf-b471-e4783656823e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:34.522970 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.523679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.530700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.531881 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.532884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.533506 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.552611 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac HTTP/1.1 May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:34.554453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.556062 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'f582d9e6-0bc1-47e8-9500-9c7501f659ac'} May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:34.556960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.558463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:34.562478 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:34.564547 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ebb5bca8-1543-4faa-9355-faad34ca5749 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 404 len: 111 microversion: 2.1 time: 0.045864 May 11 06:05:34.576534 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.577600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: f582d9e6-0bc1-47e8-9500-9c7501f659ac] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.580461 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 540/1089] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:34 2022] DELETE /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:34.585112 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.585888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.586852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.587452 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.606854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac HTTP/1.1 May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:34.611670 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.613300 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'f582d9e6-0bc1-47e8-9500-9c7501f659ac'} May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:34.614212 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. May 11 06:05:34.615615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:34.618586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance f582d9e6-0bc1-47e8-9500-9c7501f659ac could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:34.619644 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-edab1ddc-72ac-4c00-b695-d903c4ea467a tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac" status: 404 len: 111 microversion: 2.1 time: 0.050257 May 11 06:05:34.620377 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 550/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:34 2022] GET /compute/v2.1/servers/f582d9e6-0bc1-47e8-9500-9c7501f659ac => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:34.711559 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-c0597ab8-e456-4d2b-95e1-d9baa58d3839 req-a1771af8-a6f5-4c5e-bc0a-672e0eb0669a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b347d8e-b37a-4081-834a-c25569880ac3", "name": "network-vif-deleted", "tag": "6c58b2d0-18cb-4cf4-8be6-a437e75d6164"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:34.725864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.726832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.732434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c0597ab8-e456-4d2b-95e1-d9baa58d3839 req-a1771af8-a6f5-4c5e-bc0a-672e0eb0669a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.732815 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-c0597ab8-e456-4d2b-95e1-d9baa58d3839 req-a1771af8-a6f5-4c5e-bc0a-672e0eb0669a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.736576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.737379 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.738467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.739186 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.778013 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-c0597ab8-e456-4d2b-95e1-d9baa58d3839 req-a1771af8-a6f5-4c5e-bc0a-672e0eb0669a service nova] Creating event network-vif-deleted:6c58b2d0-18cb-4cf4-8be6-a437e75d6164 for instance 0b347d8e-b37a-4081-834a-c25569880ac3 on hv-cinder-73362 May 11 06:05:34.789813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-c0597ab8-e456-4d2b-95e1-d9baa58d3839 req-a1771af8-a6f5-4c5e-bc0a-672e0eb0669a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082880 May 11 06:05:34.790420 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 541/1091] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:34.854415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:34.855459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:34.862125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.862581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:34.863555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:34.864298 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.225222 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:35.232885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ea7baec4-7e02-4415-a90f-dd20b7f801a6 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.512393 May 11 06:05:35.233494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 551/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:34 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:35.259218 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:35.260040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:35.272640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.273389 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.274525 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.275137 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.325105 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:35.334309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.334778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.335416 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-74f908fc-fa45-4f4e-a6f0-2a1e683203c1 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.485567 May 11 06:05:35.335789 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lazy-loading 'fault' on Instance uuid 0b347d8e-b37a-4081-834a-c25569880ac3 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:35.345504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 542/1093] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:34 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:35.345504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:35.345504 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:35.353257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.354459 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.356621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.357074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.399178 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2d83bcc02a43f89ba4785a9bdedd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2279e41c4ffe455d9f5d126d3d288333', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:35.411070 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-514cc279-8083-4eba-9f79-d65a094d0e0c tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 200 len: 1327 microversion: 2.1 time: 0.173105 May 11 06:05:35.417140 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 552/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:35 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:35.436904 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:35.446095 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1ad9a170-c651-4d97-803f-3b2f8366adf5 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1136 microversion: 2.1 time: 0.108351 May 11 06:05:35.446675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 543/1095] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:35 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1136 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:35.670336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-8ed58863-d6a7-4aba-a4ff-830517bb2021 req-043d01f7-7616-4be4-9d76-62733a6c6238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5087c8ce-fb5a-41e4-8a67-29b862a5da62", "tag": "4753529c-ae61-4457-b84d-2f5703b379eb"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:35.680075 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-8ed58863-d6a7-4aba-a4ff-830517bb2021 req-043d01f7-7616-4be4-9d76-62733a6c6238 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.680799 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-8ed58863-d6a7-4aba-a4ff-830517bb2021 req-043d01f7-7616-4be4-9d76-62733a6c6238 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.699656 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-8ed58863-d6a7-4aba-a4ff-830517bb2021 req-043d01f7-7616-4be4-9d76-62733a6c6238 service nova] Creating event network-changed:4753529c-ae61-4457-b84d-2f5703b379eb for instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 on hv-cinder-73362 May 11 06:05:35.705625 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-8ed58863-d6a7-4aba-a4ff-830517bb2021 req-043d01f7-7616-4be4-9d76-62733a6c6238 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039137 May 11 06:05:35.706303 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 553/1096] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:35.872139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:35.872139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:35.878666 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.879119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.879888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.880330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.895519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f HTTP/1.1 May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:35.897181 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.898647 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '82b2d041-06d4-4ffe-925b-2dead207e93f'} May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:35.899413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.900659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:35.902324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:35.902324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d686b2e1-301f-4d01-afcf-ba420d83b4f3 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 404 len: 111 microversion: 2.1 time: 0.030960 May 11 06:05:35.902324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 544/1097] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:35 2022] DELETE /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:35.907705 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:35.908407 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] [instance: 82b2d041-06d4-4ffe-925b-2dead207e93f] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:35.914413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.914862 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.915631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:35.916069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:35.930395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] HTTP exception thrown: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Request method failure captured: May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f HTTP/1.1 May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BthvODLBHLQto7xpZlMNy7tre7HuaPBKTFhpe8nqlZYsPeayi-6yicfqvSgLHR6UtIeuoGuMpywRHiFaEY0slw0zfMGyXYdTIO8uVyAZplaPq89uHu47eGvHDDrK1bZEMvyZY7sAnlT4BOM8lly_qp6BlLKQnvG_yY4tllQDVe3LA May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:35.932046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/34db399b717b42f18c5190acb605918f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_34db399b717b42f18c5190acb605918f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/34db399b717b42f18c5190acb605918f"}]}] May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 34db399b717b42f18c5190acb605918f May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1373637515 May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 4892d58f399a44b485514cb29f2259b1 May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeNegativeTest-1373637515-project May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.933518 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '82b2d041-06d4-4ffe-925b-2dead207e93f'} May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:35.934439 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. May 11 06:05:35.937127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:35.938575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] Returning 404 to user: Instance 82b2d041-06d4-4ffe-925b-2dead207e93f could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:35.938575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-55777d02-4abf-472c-a230-0fd382774317 tempest-AttachVolumeNegativeTest-1373637515 tempest-AttachVolumeNegativeTest-1373637515-project] 10.222.0.44 "GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f" status: 404 len: 111 microversion: 2.1 time: 0.030121 May 11 06:05:35.938575 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 554/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:35 2022] GET /compute/v2.1/servers/82b2d041-06d4-4ffe-925b-2dead207e93f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:36.251397 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:36.252190 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:36.258531 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.259327 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.260183 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.260822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.358600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:36.360640 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:36.369051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.369825 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.370898 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.371471 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.583848 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:36.592793 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4f8f26d5-a4d5-4718-8b39-ddf8bc28ca76 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.345724 May 11 06:05:36.593725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 545/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:36 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:36.598617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:36.599231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:36.605762 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.606434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.606567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:36.607510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.608148 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.614268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0ac2ceb7-1464-48fa-b482-7059795f0d96 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.264999 May 11 06:05:36.614848 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 555/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:36 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:36.619570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:36.620462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:36.627149 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.627905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.628914 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:36.629579 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:36.639844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 HTTP/1.1 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:36.642769 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:36.644159 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '0b347d8e-b37a-4081-834a-c25569880ac3'} May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:36.644933 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:36.646242 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:36.647409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:36.647409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d3f1c62c-6016-4927-8459-147e0e7c3952 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 404 len: 111 microversion: 2.1 time: 0.049416 May 11 06:05:36.647409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 546/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:36 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:36.659231 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-cb071441-7569-4413-8de4-d2692bf2dd04 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '.version_select at 0x7fa13af40820>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:36.683986 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-cb071441-7569-4413-8de4-d2692bf2dd04 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852646995" status: 202 len: 0 microversion: 2.1 time: 0.034242 May 11 06:05:36.684566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 547/1102] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 06:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852646995 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:05:36.725732 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:36.734814 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-350a3cc3-4259-4967-abe4-50133fbc86ac tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1210 microversion: 2.1 time: 0.118644 May 11 06:05:36.735852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 556/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:36 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:37.612047 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:37.613365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:37.620817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:37.621388 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:37.622285 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:37.622812 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:37.631416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:37.632568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:37.642084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:37.642984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:37.648077 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:37.648605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:38.121018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:38.136176 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:38.136888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0f588196-efec-47f0-809e-bbe983b1d88c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.509135 May 11 06:05:38.138042 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 557/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:37 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:38.144204 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:38.145066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:38.153086 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:38.154924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:38.156803 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:38.157681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:38.158611 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bb32d537-f52d-4379-b5db-950fdd46aabe tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.551540 May 11 06:05:38.163858 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 548/1105] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:37 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:38.445483 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:38.455004 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ce1c9585-48cb-4305-a09a-dfe6bca2bd27 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.315660 May 11 06:05:38.456265 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 558/1106] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:38 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:39.156597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:39.157223 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:39.164290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.164950 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.165765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.166210 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.187985 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:39.190286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:39.198271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.199101 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.200402 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.201293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.401210 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:39.414383 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-40bc720f-1531-4fcf-a4cd-b357ad58fd7d tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.237459 May 11 06:05:39.426197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 559/1107] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:39 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:39.473167 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:39.473969 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:39.481715 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.484504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.485327 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.485975 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.621912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:39.629738 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-68756ef3-6246-48ce-9d82-893be23eb33c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.478181 May 11 06:05:39.630943 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 549/1108] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:39 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:39.667490 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:39.677258 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a113485c-de83-4823-a528-6c37c4885ed7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.207856 May 11 06:05:39.688555 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 560/1109] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:39 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:39.908848 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-60f39938-38d2-4d30-b50c-c48bfe9a39f2 req-dcfccf16-9dfe-42e5-bba7-798f7df91d2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:39.918748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-60f39938-38d2-4d30-b50c-c48bfe9a39f2 req-dcfccf16-9dfe-42e5-bba7-798f7df91d2f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:39.919306 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-60f39938-38d2-4d30-b50c-c48bfe9a39f2 req-dcfccf16-9dfe-42e5-bba7-798f7df91d2f service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:39.935274 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-60f39938-38d2-4d30-b50c-c48bfe9a39f2 req-dcfccf16-9dfe-42e5-bba7-798f7df91d2f service nova] Creating event network-changed:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:05:39.941591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-60f39938-38d2-4d30-b50c-c48bfe9a39f2 req-dcfccf16-9dfe-42e5-bba7-798f7df91d2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037022 May 11 06:05:39.943837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 550/1110] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:40.096496 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:40.097292 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:40.103669 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.104313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.105267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.105903 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.124049 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 HTTP/1.1 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:40.125558 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.127253 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '0b347d8e-b37a-4081-834a-c25569880ac3'} May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:40.128089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.129610 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:40.132434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:40.132434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d5a2c3c9-11c0-40de-aa5e-edc7c4cd2758 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 404 len: 111 microversion: 2.1 time: 0.035078 May 11 06:05:40.132434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 561/1111] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:40 2022] DELETE /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:40.137651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:40.138396 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: 0b347d8e-b37a-4081-834a-c25569880ac3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:40.144794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.145246 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.146048 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.146483 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.159932 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 HTTP/1.1 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:40.161563 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.163328 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '0b347d8e-b37a-4081-834a-c25569880ac3'} May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:40.167324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. May 11 06:05:40.168827 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:40.171331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance 0b347d8e-b37a-4081-834a-c25569880ac3 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:40.171331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a9953075-0b88-41b9-866c-0a60e5fb6ed3 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3" status: 404 len: 111 microversion: 2.1 time: 0.030618 May 11 06:05:40.171331 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 551/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:40 2022] GET /compute/v2.1/servers/0b347d8e-b37a-4081-834a-c25569880ac3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:40.432211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:40.432824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:40.439820 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.440274 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.441047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.441493 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.646695 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:40.649592 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:40.650348 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:40.659495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c30f8a8d-60c1-4a1f-ae7b-0bd586511722 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.231063 May 11 06:05:40.661703 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.665846 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.667002 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.667616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.675449 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 562/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:40 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:40.694486 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:40.695099 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:40.702597 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.703131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.703837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:40.704313 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:40.802309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:40.810072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-dbf878af-5298-4427-9414-8c44c918b319 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.166670 May 11 06:05:40.810663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 552/1114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:40 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:40.893488 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:40.901432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4cda6a92-b286-4c23-a006-5d3061807079 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.211019 May 11 06:05:40.902030 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 563/1115] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:40 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:41.324079 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:41.324582 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:41.335259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.336201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.337621 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.338289 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.356065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 HTTP/1.1 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:05:41.358837 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.360355 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'af7c8f3d-2da4-4399-ac9d-42f991a37c96'} May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:41.361122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.362425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:05:41.365240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:41.366251 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d2bf0421-accb-45b3-9682-5fe270273057 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 404 len: 111 microversion: 2.1 time: 0.046201 May 11 06:05:41.367341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 553/1116] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:41 2022] DELETE /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:41.376851 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:41.377881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] [instance: af7c8f3d-2da4-4399-ac9d-42f991a37c96] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:41.389728 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.391361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.393306 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.393960 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.424556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] HTTP exception thrown: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Request method failure captured: May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 HTTP/1.1 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1B2eTkWzEd6tJYCWYc0BS4B9suh4enIKQwpf6pmRcslf0fb2ULVSOM8UCKkr_y8mQjCTzIxp86cJnkS9s8sPAITCfYRfSjJfwhdltvZhpFsGDIoozbVA9YztmeEi-aQvIyLLwMFxnjyck_kOSpHcc1lYU3JYonJEqiZrP-4IvBg494 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:05:41.427392 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2279e41c4ffe455d9f5d126d3d288333"}]}] May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 2279e41c4ffe455d9f5d126d3d288333 May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeTestJSON-92734394 May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: aa2d83bcc02a43f89ba4785a9bdedd15 May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeTestJSON-92734394-project May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.429276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'af7c8f3d-2da4-4399-ac9d-42f991a37c96'} May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:05:41.430237 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. May 11 06:05:41.431868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:05:41.435336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] Returning 404 to user: Instance af7c8f3d-2da4-4399-ac9d-42f991a37c96 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:05:41.436693 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-878e2f6a-eb3e-449b-af71-f17a4bc66673 tempest-AttachVolumeTestJSON-92734394 tempest-AttachVolumeTestJSON-92734394-project] 10.222.0.44 "GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96" status: 404 len: 111 microversion: 2.1 time: 0.065501 May 11 06:05:41.437766 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 564/1117] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:41 2022] GET /compute/v2.1/servers/af7c8f3d-2da4-4399-ac9d-42f991a37c96 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:05:41.676835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:41.677463 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:41.684564 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.684745 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.685969 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.686581 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.827170 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:41.828168 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:41.834621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.835888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.848910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:41.849681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:41.996204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:42.005822 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5551403e-5c8d-4969-ba56-d132115eedb5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.332520 May 11 06:05:42.016601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 554/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:41 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:42.024363 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:42.025157 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:42.032381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:42.033086 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:42.034227 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:42.034834 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:42.094637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:42.102245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-278bdde1-3050-4839-8964-a7862291f5c9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.279088 May 11 06:05:42.102888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 565/1119] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:41 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:42.343434 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:42.352076 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7463861d-28bd-48c1-b192-176a41990ea3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.334708 May 11 06:05:42.353119 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 555/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:42 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:43.024120 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:43.024731 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:43.031694 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.032152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.033139 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.033767 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.119255 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:43.119960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:43.133492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.140540 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.141861 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.147016 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.221295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:43.230868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-66e63a84-1a13-43e6-980e-acc35ea63067 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.209336 May 11 06:05:43.242066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 566/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:43 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:43.371524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:43.372246 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:43.381268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.383028 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.387652 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.387839 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.559834 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:43.569271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6f020919-8ce9-4a31-87e8-1c0c69f7d74f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.200870 May 11 06:05:43.579448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 567/1122] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:43 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:43.754454 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-0959c2b6-01e4-412c-b367-81c1c699ee18 req-1bd99ecc-b7c3-49cd-9dc9-bba297b85e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5087c8ce-fb5a-41e4-8a67-29b862a5da62", "name": "network-vif-plugged", "status": "completed", "tag": "4753529c-ae61-4457-b84d-2f5703b379eb"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:43.771646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0959c2b6-01e4-412c-b367-81c1c699ee18 req-1bd99ecc-b7c3-49cd-9dc9-bba297b85e93 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:43.772432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-0959c2b6-01e4-412c-b367-81c1c699ee18 req-1bd99ecc-b7c3-49cd-9dc9-bba297b85e93 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:43.787245 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-0959c2b6-01e4-412c-b367-81c1c699ee18 req-1bd99ecc-b7c3-49cd-9dc9-bba297b85e93 service nova] Creating event network-vif-plugged:4753529c-ae61-4457-b84d-2f5703b379eb for instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 on hv-cinder-73362 May 11 06:05:43.797111 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-0959c2b6-01e4-412c-b367-81c1c699ee18 req-1bd99ecc-b7c3-49cd-9dc9-bba297b85e93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044778 May 11 06:05:43.798085 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 568/1123] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:43.819112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:43.830911 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-58bc45ae-a89a-43c8-8336-df49fbc57f66 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.715498 May 11 06:05:43.831809 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 556/1124] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:43 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:44.251606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:44.253148 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:44.262127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.262691 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:44.264914 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.266196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:44.458420 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:44.469293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-88e5e4b1-fc3f-43d4-9f25-2aa4d2311c99 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.224795 May 11 06:05:44.469916 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 569/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:44 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:44.586617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:44.587379 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:44.594524 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.595058 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:44.595905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.596420 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:44.741431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:44.752507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-404bc081-3249-4e2f-b60f-b1b364d812ab tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.169447 May 11 06:05:44.753166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 557/1126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:44 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:44.849146 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:44.849786 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:44.856333 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.856792 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:44.858447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:44.859403 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.099560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:45.109567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5d32a412-fa9c-4974-834c-3821b2bf78ce tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1313 microversion: 2.1 time: 0.264319 May 11 06:05:45.118408 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 570/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:44 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:45.492012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:45.493305 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:45.500188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:45.500826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.501680 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:45.502394 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.716682 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:45.733415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-eb76ff38-9d88-4d65-a028-0ccd17ff838b tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.249331 May 11 06:05:45.738295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 558/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:45 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:45.771330 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:45.774479 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:45.792325 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:45.792867 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.793801 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:45.794713 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.822335 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-8f7477c2-4a7b-4c28-877c-2f87d5d37ee2 req-84549fc5-9424-47c5-be24-7c0371defbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "name": "network-vif-plugged", "status": "completed", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:45.835614 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-8f7477c2-4a7b-4c28-877c-2f87d5d37ee2 req-84549fc5-9424-47c5-be24-7c0371defbf9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:45.842209 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-8f7477c2-4a7b-4c28-877c-2f87d5d37ee2 req-84549fc5-9424-47c5-be24-7c0371defbf9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:45.870325 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-8f7477c2-4a7b-4c28-877c-2f87d5d37ee2 req-84549fc5-9424-47c5-be24-7c0371defbf9 service nova] Creating event network-vif-plugged:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:05:45.879471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-8f7477c2-4a7b-4c28-877c-2f87d5d37ee2 req-84549fc5-9424-47c5-be24-7c0371defbf9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061244 May 11 06:05:45.880069 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 559/1129] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:46.061708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:46.073084 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d47e1e13-0597-495e-a42a-1541b629451a tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.306730 May 11 06:05:46.073707 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 571/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:45 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:46.128359 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:46.129384 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:46.136057 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:46.136835 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:46.137961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:46.138500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:46.364528 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:46.375704 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-f1cd102a-ec7c-43ac-a12d-e90e54f37af0 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1497 microversion: 2.1 time: 0.252620 May 11 06:05:46.377074 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 560/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:46 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:46.751094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:46.751230 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:46.757082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:46.757568 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:46.758489 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:46.758938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:46.914874 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:46.922719 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ec2bd625-0bf5-4fe3-b72a-7003cdf05edb tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.175879 May 11 06:05:46.923284 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 572/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:46 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:47.066985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.067503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.073799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.074257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.075031 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.075473 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.090069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.090994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.098872 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.099340 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.100123 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.100566 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.101871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:05:47.218381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-978e4a60-62a8-4c49-80aa-3e1b567bb282 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 204 len: 0 microversion: 2.1 time: 0.153352 May 11 06:05:47.219548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 561/1133] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:05:47 2022] DELETE /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:05:47.228421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.229098 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.236890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.237862 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.238976 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.239830 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.286052 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:47.295089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2b61ff3e-4e6e-47a5-974b-c4740696498c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.208730 May 11 06:05:47.296987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 573/1134] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:47 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:47.418112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:47.431158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4d01a5ab-d224-40f2-8c51-59ea591058bf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.207080 May 11 06:05:47.431945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 562/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:47 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:47.855192 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.856171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.866583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.867046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.867842 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.868287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.901017 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4325d4d1-afdf-4ac5-9511-84845b248469 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049677 May 11 06:05:47.901607 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 574/1136] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 06:05:47 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:47.940619 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.941241 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.947203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.947656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.948432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.948874 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.959215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:47.959709 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:47.966510 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.967026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.968057 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:47.968502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:47.994485 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:05:48.073688 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-107ffee6-9569-4e3b-a858-fa2d114fb0c2 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 204 len: 0 microversion: 2.20 time: 0.117947 May 11 06:05:48.077539 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 575/1137] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 06:05:47 2022] DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 06:05:48.083267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:48.083972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:48.086310 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.089684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.090140 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.090915 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.091355 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.094229 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ce8ef947-8c62-491b-85a7-7d738a1a1449 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.158510 May 11 06:05:48.094873 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 563/1138] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:47 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:48.223927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.231633 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.233788 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.234948 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-47c310ed-08fc-4496-b13f-8498a7f61bf0 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.155777 May 11 06:05:48.235510 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 576/1139] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:48 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:05:48.312612 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:48.313230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:48.319203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.319653 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.320419 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.320853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.449207 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:48.449876 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:48.453383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.455806 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.456261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.457040 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:48.457495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:48.460978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d98b2db8-3ea6-4d1c-85a6-38d443d04c98 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.152969 May 11 06:05:48.461680 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 564/1140] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:48 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:48.581724 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:48.589108 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a5aca2c1-3222-4566-8c06-60a1e2e5084c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.143769 May 11 06:05:48.589737 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 577/1141] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:48 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:49.111895 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:49.112511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:49.119101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.119546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.120299 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.120725 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.251422 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.253618 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:49.254316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:49.258806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ae6bcb22-f26f-4224-aa72-e0be116224a4 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.151243 May 11 06:05:49.259377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 565/1142] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:49 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:49.260580 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.261041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.261841 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.262287 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.390213 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.398195 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.399703 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.400868 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d6892d82-c6f8-4528-ac01-712550a2be47 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.151359 May 11 06:05:49.401423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 578/1143] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:49 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:05:49.477166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:49.477948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:49.483906 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.484347 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.485099 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.485559 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.606641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:49.608169 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:49.612732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.614445 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.614824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.615616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:49.616062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:49.620562 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9ff33b2a-84d6-45b2-8361-fddc7cca5517 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.147192 May 11 06:05:49.621137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 566/1144] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:49 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:49.748650 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:49.756107 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2ecbfb1c-f4f2-4d79-a0b9-9d81ff3abc02 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.153356 May 11 06:05:49.756681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 579/1145] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:49 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:50.279826 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:50.280948 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:50.288995 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.289768 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.291369 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.292312 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.420360 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:50.420970 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:50.427256 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.427708 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.428484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.428925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.433112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:50.441198 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9fbe524c-c514-466b-9c63-c5286f746fc3 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1575 microversion: 2.1 time: 0.168599 May 11 06:05:50.441961 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 567/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:50 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:50.561215 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:50.569117 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:50.570743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:50.571899 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4f805cd0-e584-4fe3-a3a0-804bb5f8bc02 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.155703 May 11 06:05:50.572455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 580/1147] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:50 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:05:50.638367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:50.639638 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:50.646261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.646709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.647481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.647941 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.773007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:50.773567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:50.778655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:50.779583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.780041 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.780814 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:50.781247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:50.786313 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5a0a5747-f549-417f-8acb-e5ff2ee895f0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.152135 May 11 06:05:50.786886 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 568/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:50 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:51.163901 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.173857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-82fdc91e-9479-4925-934e-bdfe69b4c73b tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.404285 May 11 06:05:51.183062 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 581/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:50 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:51.465134 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:51.465780 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:51.472561 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.473018 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.473816 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.474253 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.590502 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:51.591125 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:51.598076 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.598530 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.599315 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.599756 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.617262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.625238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e7ddcde0-035a-46a5-91fd-50de8c547ca5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1562 microversion: 2.1 time: 0.163957 May 11 06:05:51.626028 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 569/1150] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:51 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:51.730157 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.738702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.740209 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.741390 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f793e491-8d04-4d6a-83a5-7f71b586b579 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.154840 May 11 06:05:51.741992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 582/1151] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:51 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 06:05:51.802515 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:51.803130 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:51.808841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.809290 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.810089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:51.810597 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:51.937907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:51.945309 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-937780b7-bee2-48df-9ef1-07092cd60709 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.146612 May 11 06:05:51.945924 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 570/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:51 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:52.190430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:52.191043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:52.196866 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.197318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:52.198124 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.198557 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:52.332394 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:52.340081 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5d563a6d-3db6-4146-8caa-86bd60e98e53 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.153508 May 11 06:05:52.340660 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 583/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:52 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:52.759601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:52.760223 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:52.767561 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.768014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:52.768785 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.769228 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:52.894585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:52.902471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:52.904767 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:52.905982 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8c03286d-54f0-480f-a271-74fec44dc9cd tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.150405 May 11 06:05:52.906565 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 571/1154] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:52 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:52.962875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:52.963492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:52.970742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.971200 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:52.971974 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:52.972413 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:53.098725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:53.105978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ef283d93-985d-4c6d-98f5-5d8c445b1412 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.146943 May 11 06:05:53.106546 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 584/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:52 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:53.358075 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:53.358794 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:53.364841 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:53.365286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:53.366081 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:53.366516 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:53.499426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:53.506632 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-60ee6f0a-2e28-4f31-8166-0419a5b33011 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.153248 May 11 06:05:53.507201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 572/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:53 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:53.924935 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:53.925593 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:53.931481 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:53.931938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:53.932714 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:53.933152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:54.056578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:54.064336 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:54.065886 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:54.067047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4267a883-7240-4a1b-8210-70676df2f7a1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.147065 May 11 06:05:54.067606 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 585/1157] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:53 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:54.122365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:54.123104 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:54.129541 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:54.129991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:54.130756 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:54.131201 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:54.260140 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:54.268237 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0cd5fd96-98f2-4723-b523-4ac76c5abb67 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.149756 May 11 06:05:54.268806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 573/1158] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:54 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:54.523740 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:54.524359 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:54.530675 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:54.531131 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:54.531901 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:54.532342 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:54.662272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:54.669925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e270f45d-f47d-48f9-8c64-80c2cc5e8e67 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.150012 May 11 06:05:54.670507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 586/1159] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:54 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:55.085212 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:55.085907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:55.092965 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.093617 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.094383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.094865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.231613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:55.240014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:55.241623 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:55.242798 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ef1f9909-3316-4414-91ee-2d49fb21ef4d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.161613 May 11 06:05:55.243549 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 574/1160] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:55 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:55.284765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:55.285380 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:55.291972 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.292434 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.293211 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.293681 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.344981 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1c49033c-821f-4033-98b2-ee933cee415c req-980db172-0fb2-4915-9d7b-00467641cdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "name": "network-vif-plugged", "status": "completed", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:55.353320 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1c49033c-821f-4033-98b2-ee933cee415c req-980db172-0fb2-4915-9d7b-00467641cdc2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.354194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1c49033c-821f-4033-98b2-ee933cee415c req-980db172-0fb2-4915-9d7b-00467641cdc2 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.368737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1c49033c-821f-4033-98b2-ee933cee415c req-980db172-0fb2-4915-9d7b-00467641cdc2 service nova] Creating event network-vif-plugged:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:05:55.373890 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1c49033c-821f-4033-98b2-ee933cee415c req-980db172-0fb2-4915-9d7b-00467641cdc2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033282 May 11 06:05:55.374500 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 575/1161] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:55.430991 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:55.438630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-639a9d57-db6e-4410-a8b1-7a2d8d094021 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.157767 May 11 06:05:55.439198 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 587/1162] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:55 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:05:55.687519 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:55.688221 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:55.694737 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.695191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.695960 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:55.696707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:55.839356 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:55.847829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-aa130295-dc56-4528-8e7f-7d3a71290990 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.164632 May 11 06:05:55.848539 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 576/1163] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:55 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:56.260468 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:56.261299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:56.269034 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.269553 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:56.270365 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.270850 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:56.405626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:56.413335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:56.414878 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:56.416043 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9b7f0add-b005-41df-9a83-fcf2a2c847e1 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.159643 May 11 06:05:56.416611 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 588/1164] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:56 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:56.455383 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:56.456027 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:56.462329 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.462784 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:56.463615 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.464087 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:56.598897 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:56.606137 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a75f8f91-0538-42db-a376-8672b36aa52d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.154703 May 11 06:05:56.606694 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 577/1165] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:56 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:56.864163 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:56.864781 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:56.870939 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.871395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:56.872171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:56.872784 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:57.005982 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:57.014295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a3b21cab-d4cf-4adb-bc1c-4a3d56b3ff46 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1503 microversion: 2.1 time: 0.153346 May 11 06:05:57.015054 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 589/1166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:56 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:57.436984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:57.437974 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:57.447537 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:57.448280 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:57.458799 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:57.463650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:57.629570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:57.631276 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:57.643332 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:57.644012 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:57.645556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:57.646156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:57.877535 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:57.886003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:57.887761 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:57.889502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-da527220-9c6b-48d5-a32a-5d8732d29dbc tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1724 microversion: 2.20 time: 0.456634 May 11 06:05:57.890882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 578/1167] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:57 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:57.897988 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:57.908311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d75a9d28-c052-4519-960d-885142398c9c tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.287399 May 11 06:05:57.909519 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 590/1168] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:57 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:58.034746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:58.034746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:58.040728 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.041330 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.042685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.043286 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.075629 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-862d053e-4264-4345-b828-0c2e7154cb70 req-533db020-2095-4c5b-b612-09224885e9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5087c8ce-fb5a-41e4-8a67-29b862a5da62", "name": "network-vif-deleted", "tag": "4753529c-ae61-4457-b84d-2f5703b379eb"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:58.091427 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-862d053e-4264-4345-b828-0c2e7154cb70 req-533db020-2095-4c5b-b612-09224885e9f9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.093049 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-862d053e-4264-4345-b828-0c2e7154cb70 req-533db020-2095-4c5b-b612-09224885e9f9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.108757 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-862d053e-4264-4345-b828-0c2e7154cb70 req-533db020-2095-4c5b-b612-09224885e9f9 service nova] Creating event network-vif-deleted:4753529c-ae61-4457-b84d-2f5703b379eb for instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 on hv-cinder-73362 May 11 06:05:58.115278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-862d053e-4264-4345-b828-0c2e7154cb70 req-533db020-2095-4c5b-b612-09224885e9f9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044022 May 11 06:05:58.116018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 591/1169] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:05:58.136554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:58.145491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-aea37ab8-424f-43b5-b909-ff4989ce2a24 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1461 microversion: 2.1 time: 0.117014 May 11 06:05:58.146375 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 579/1170] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:58 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:58.282104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-48c245c4-8146-46f7-8aca-cce08053c0d8 req-30be326e-7124-4be6-9368-75f1f15738ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5020c511-6684-4f25-8d07-840612e810f0", "name": "network-vif-deleted", "tag": "46993fce-15d3-442b-82c6-0275faa7fe4f"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:05:58.290729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-48c245c4-8146-46f7-8aca-cce08053c0d8 req-30be326e-7124-4be6-9368-75f1f15738ad service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.291184 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-48c245c4-8146-46f7-8aca-cce08053c0d8 req-30be326e-7124-4be6-9368-75f1f15738ad service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.306321 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-48c245c4-8146-46f7-8aca-cce08053c0d8 req-30be326e-7124-4be6-9368-75f1f15738ad service nova] Creating event network-vif-deleted:46993fce-15d3-442b-82c6-0275faa7fe4f for instance 5020c511-6684-4f25-8d07-840612e810f0 on hv-cinder-73362 May 11 06:05:58.312318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-48c245c4-8146-46f7-8aca-cce08053c0d8 req-30be326e-7124-4be6-9368-75f1f15738ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034945 May 11 06:05:58.313273 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 592/1171] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:05:58.908479 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:58.909024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:58.915366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.916065 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.917040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.917679 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.927100 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:58.927815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:58.935927 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.941038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.941924 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.942386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.971485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:58.972368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:58.975421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lazy-loading 'fault' on Instance uuid 5020c511-6684-4f25-8d07-840612e810f0 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:59.038727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:59.048732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:59.051423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8396cfed6d904f859ade91e210c619b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f4f0f35ae0b4c94977f2e1688dbdb5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:59.053713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0fc4f16b-ae74-40a6-ab50-58bab9ce3d60 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 200 len: 1371 microversion: 2.20 time: 0.148795 May 11 06:05:59.054759 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 580/1172] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:05:58 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 06:05:59.162865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:05:59.163492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:05:59.174773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:59.175216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:59.176012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:59.176453 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:59.200159 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:59.208293 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-84a3e82d-1af8-4bc9-a6ba-50b2cbd2af4f tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1266 microversion: 2.1 time: 0.285758 May 11 06:05:59.208888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 593/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:58 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:05:59.266613 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:05:59.267072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:05:59.267536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.objects.instance [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lazy-loading 'fault' on Instance uuid 5087c8ce-fb5a-41e4-8a67-29b862a5da62 {{(pid=117335) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:05:59.316049 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:05:59.324753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-31bc1c57-d296-4830-955d-ab7dd6f55f9e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 200 len: 1303 microversion: 2.1 time: 0.164728 May 11 06:05:59.324753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 581/1174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:05:59 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:06:00.074288 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:00.074905 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:00.081847 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.082308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.083088 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.083527 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.097663 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 HTTP/1.1 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:00.099361 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:00.101023 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '5020c511-6684-4f25-8d07-840612e810f0'} May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:00.101907 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:00.103261 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:00.104451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:00.104451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0b498de6-69b5-4be9-8344-d67fb872272b tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 404 len: 111 microversion: 2.20 time: 0.030310 May 11 06:06:00.104451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 594/1175] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:06:00 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:06:00.110353 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4b0ea5b5-13ee-4ecf-95a9-e16b9dfe9403 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '.version_select at 0x7fa1403ab3a0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:00.131080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4b0ea5b5-13ee-4ecf-95a9-e16b9dfe9403 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623292215" status: 204 len: 0 microversion: 2.20 time: 0.025090 May 11 06:06:00.131672 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 582/1176] 10.222.0.44 () {60 vars in 1261 bytes} [Wed May 11 06:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1623292215 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 06:06:00.228238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:00.229104 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:00.239729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.241045 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.242016 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.242697 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.342574 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:00.343267 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: 5087c8ce-fb5a-41e4-8a67-29b862a5da62] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:00.358032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.358560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.359491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.360123 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.399491 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] HTTP exception thrown: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Request method failure captured: May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 HTTP/1.1 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1IlvHWG-wM0PFQOYa0inomD7Hl4e186D33nSKOvn9Iq8MrL5qZqFseSz_wf5JWd58QOusldsUcwvda2x9TEADMZgGLx0FtS-et1GDi8tOBA7QnJKvFcof5rzmkkFHu8OD31hEa2Rz56glkFWJEtGRxuX4uOZThPdI6KgnATlCmkRVg May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: a40603d2f46d4ad2986e9277a47a8211 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesActionsTest-323471262 May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:00.403487 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a40603d2f46d4ad2986e9277a47a8211"}]}] May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesActionsTest-323471262 May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: a40603d2f46d4ad2986e9277a47a8211 May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesActionsTest-323471262 May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesActionsTest-323471262-project May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 34e24c80364642b083dc32697f7320ad May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesActionsTest-323471262-project May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. May 11 06:06:00.405399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '5087c8ce-fb5a-41e4-8a67-29b862a5da62'} May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:00.406421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. May 11 06:06:00.408001 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:00.412696 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Returning 404 to user: Instance 5087c8ce-fb5a-41e4-8a67-29b862a5da62 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:00.414940 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-9103bc87-b408-4501-85f3-e6fcdee5af86 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62" status: 404 len: 111 microversion: 2.1 time: 0.077513 May 11 06:06:00.420374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 583/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:00 2022] GET /compute/v2.1/servers/5087c8ce-fb5a-41e4-8a67-29b862a5da62 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:00.452039 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:00.465191 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8ce8c25f-bffc-45f7-b2d7-6adb14b58c2e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1453 microversion: 2.1 time: 0.239218 May 11 06:06:00.476013 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 595/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:00 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1453 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:00.483546 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:00.484432 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:00.492113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.492753 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.493942 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:00.494567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:00.611377 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1104669809", "imageRef": "4918666f-6891-49d8-b432-edf6a613446c", "flavorRef": "452", "networks": [{"uuid": "63a19bd2-5787-45d5-8224-96cb62668c41"}]}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:00.677769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.network.neutron [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] validate_networks() for [('63a19bd2-5787-45d5-8224-96cb62668c41', None, None, None, None, None)] {{(pid=117334) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 06:06:00.774319 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:00.783203 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d28d7a33-75b4-4c81-a6eb-152749e753cc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1453 microversion: 2.1 time: 0.304585 May 11 06:06:00.795079 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 584/1179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:00 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1453 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:01.180033 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Flavor limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 06:06:01.180615 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Image limits 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 06:06:01.183846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Flavor pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 06:06:01.183846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Image pref 0:0:0 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 06:06:01.183846 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.virt.hardware [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117334) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 06:06:01.194626 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:01.195353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:01.196278 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:01.196835 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:01.216316 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Getting quotas for project a40603d2f46d4ad2986e9277a47a8211. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 06:06:01.223007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.quota [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Getting quotas for user 34e24c80364642b083dc32697f7320ad and project a40603d2f46d4ad2986e9277a47a8211. Resources: {'instances', 'cores', 'ram'} {{(pid=117334) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 06:06:01.238631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Going to run 1 instances... {{(pid=117334) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 06:06:01.241290 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4918666f-6891-49d8-b432-edf6a613446c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117334) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 06:06:01.287076 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f99ef176-25a5-4da2-bbdd-17ecf4e49cba tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679724 May 11 06:06:01.288061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 596/1180] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 06:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 06:06:01.298661 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-86653235-dcad-4bdc-a37d-7d884df252f9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:01.299923 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-86653235-dcad-4bdc-a37d-7d884df252f9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:01.353377 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-86653235-dcad-4bdc-a37d-7d884df252f9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:01.361112 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-86653235-dcad-4bdc-a37d-7d884df252f9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1214 microversion: 2.1 time: 0.067132 May 11 06:06:01.361712 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 585/1181] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:01 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:02.267748 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:02.268266 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:02.275516 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.276048 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.277097 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.277643 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.297295 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 HTTP/1.1 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:02.299324 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.300855 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '5020c511-6684-4f25-8d07-840612e810f0'} May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:02.301690 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.302961 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:02.307451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:02.308560 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9d2f808e-0ed7-4ee3-9582-8512c0a992d5 tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 404 len: 111 microversion: 2.20 time: 0.045730 May 11 06:06:02.309637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 597/1182] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 06:06:02 2022] DELETE /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:06:02.318585 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:02.319977 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 5020c511-6684-4f25-8d07-840612e810f0] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:02.327817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.328259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.329080 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.329558 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.345337 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 HTTP/1.1 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:02.347191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.348967 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '5020c511-6684-4f25-8d07-840612e810f0'} May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:02.349786 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. May 11 06:06:02.351078 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:02.364936 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 5020c511-6684-4f25-8d07-840612e810f0 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:02.367283 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-33d92755-51cc-4e35-8327-8da06f43041a tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0" status: 404 len: 111 microversion: 2.20 time: 0.052586 May 11 06:06:02.370127 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 586/1183] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:06:02 2022] GET /compute/v2.1/servers/5020c511-6684-4f25-8d07-840612e810f0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:06:02.378631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:02.379528 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:02.391417 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.395637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.397139 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:02.397857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:02.507461 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:02.517676 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-401da6d6-844b-429d-9b8e-0634c80fbbad tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1274 microversion: 2.1 time: 0.143209 May 11 06:06:02.518270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 598/1184] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:02 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1274 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:03.038644 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-bf0117c5-8149-47f2-a491-a4ddaf724713 req-dc33779d-12ec-4b81-bdd6-086f23f086e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:03.052092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-bf0117c5-8149-47f2-a491-a4ddaf724713 req-dc33779d-12ec-4b81-bdd6-086f23f086e9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.052930 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-bf0117c5-8149-47f2-a491-a4ddaf724713 req-dc33779d-12ec-4b81-bdd6-086f23f086e9 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.067719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-bf0117c5-8149-47f2-a491-a4ddaf724713 req-dc33779d-12ec-4b81-bdd6-086f23f086e9 service nova] Creating event network-changed:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:06:03.079268 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-bf0117c5-8149-47f2-a491-a4ddaf724713 req-dc33779d-12ec-4b81-bdd6-086f23f086e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045616 May 11 06:06:03.080571 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 587/1185] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:03.546061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:03.547448 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:03.554677 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.555484 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.556549 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.557221 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.596939 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:03.598169 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:03.605374 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.606300 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.608128 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.608985 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.627040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 HTTP/1.1 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:03.629007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.630865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '276af0f1-c869-454b-ae66-454979121c15'} May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:03.631831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.633575 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.636438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:03.637560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e0690647-2786-46a7-88d3-5582dc975f9d tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 404 len: 111 microversion: 2.20 time: 0.044858 May 11 06:06:03.642751 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 588/1186] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 06:06:03 2022] DELETE /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 06:06:03.648450 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:03.649357 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] [instance: 276af0f1-c869-454b-ae66-454979121c15] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:03.669659 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.670395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.672663 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:03.673294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:03.708166 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] HTTP exception thrown: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Request method failure captured: May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 HTTP/1.1 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1BlQaIAZqCwNpLgiNiq6Jxk5XvBPRnBaCklnCkC87KxqIToOulMUpb3qS6RWY5uOtvriJM0k2XYzsKNBRqjdHjcMeKjJwyTCf4k3pphI8XR0ytjuzjWdAk368RuDsZpNlg5R5nkjM-Dk82xG_zMnbaV-xR1R6jaZqdrfvZM7lQQiRc May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Openstack-Nova-Api-Version: 2.20 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:03.712295 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1f4f0f35ae0b4c94977f2e1688dbdb5c"}]}] May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 1f4f0f35ae0b4c94977f2e1688dbdb5c May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1758558376 May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 8396cfed6d904f859ade91e210c619b5 May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1758558376-project May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.714215 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '276af0f1-c869-454b-ae66-454979121c15'} May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:03.715139 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. May 11 06:06:03.716724 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:03.720343 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] Returning 404 to user: Instance 276af0f1-c869-454b-ae66-454979121c15 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:03.727142 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c8314f11-d4ac-4de2-b8e3-5eb5d07c63ca tempest-AttachVolumeShelveTestJSON-1758558376 tempest-AttachVolumeShelveTestJSON-1758558376-project] 10.222.0.44 "GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15" status: 404 len: 111 microversion: 2.20 time: 0.082967 May 11 06:06:03.728014 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 589/1187] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 06:06:03 2022] GET /compute/v2.1/servers/276af0f1-c869-454b-ae66-454979121c15 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 06:06:04.120762 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:04.128850 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6f6606cf-e329-43cb-9fa0-4bdf1f4459d6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.586925 May 11 06:06:04.130003 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 599/1188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:03 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:04.694376 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-0f959496-eea2-42f3-9038-192e07ff1873 req-fea0124f-b024-40b8-9b3c-398d19a7082b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab563fe-88a2-4733-b5bc-18d175afa2c8", "tag": "e824ae60-2581-43d8-a494-eab1de9b34f1"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:04.706020 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0f959496-eea2-42f3-9038-192e07ff1873 req-fea0124f-b024-40b8-9b3c-398d19a7082b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:04.709601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-0f959496-eea2-42f3-9038-192e07ff1873 req-fea0124f-b024-40b8-9b3c-398d19a7082b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:04.729329 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-0f959496-eea2-42f3-9038-192e07ff1873 req-fea0124f-b024-40b8-9b3c-398d19a7082b service nova] Creating event network-changed:e824ae60-2581-43d8-a494-eab1de9b34f1 for instance eab563fe-88a2-4733-b5bc-18d175afa2c8 on hv-cinder-73362 May 11 06:06:04.737502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-0f959496-eea2-42f3-9038-192e07ff1873 req-fea0124f-b024-40b8-9b3c-398d19a7082b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046608 May 11 06:06:04.743173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 590/1189] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:05.147795 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:05.148524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:05.157577 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:05.158314 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:05.160440 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:05.161815 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:05.342822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:05.353386 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f496a9a9-fddf-4919-94dd-62a30a14d701 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.209193 May 11 06:06:05.354335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 600/1190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:05 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:06.373202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:06.373829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:06.389894 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:06.390912 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:06.391779 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:06.392222 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:06.734993 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:06.742840 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-70766862-33c7-4559-b985-4459695ef65c tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.374976 May 11 06:06:06.745675 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 591/1191] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:06 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:07.764567 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:07.771811 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:07.788979 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:07.789442 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:07.790272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:07.792712 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:08.179989 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:08.197947 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a31f2e78-f752-44ca-a2a3-d94fed565461 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.439766 May 11 06:06:08.198775 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 601/1192] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:07 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:09.216915 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:09.217871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:09.227700 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:09.228334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:09.229517 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:09.230257 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:09.388963 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:09.397263 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-8bd97e0e-3e36-4657-9122-23cd8c8b53b6 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.184591 May 11 06:06:09.397951 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 592/1193] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:09 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:09.441138 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-a4bed541-267c-4595-99b7-ac0911a02eb7 req-e865b8f4-a77d-4ed7-a00d-edfcc42f348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab563fe-88a2-4733-b5bc-18d175afa2c8", "name": "network-vif-plugged", "status": "completed", "tag": "e824ae60-2581-43d8-a494-eab1de9b34f1"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:09.478268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-a4bed541-267c-4595-99b7-ac0911a02eb7 req-e865b8f4-a77d-4ed7-a00d-edfcc42f348d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:09.478741 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-a4bed541-267c-4595-99b7-ac0911a02eb7 req-e865b8f4-a77d-4ed7-a00d-edfcc42f348d service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:09.518819 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-a4bed541-267c-4595-99b7-ac0911a02eb7 req-e865b8f4-a77d-4ed7-a00d-edfcc42f348d service nova] Creating event network-vif-plugged:e824ae60-2581-43d8-a494-eab1de9b34f1 for instance eab563fe-88a2-4733-b5bc-18d175afa2c8 on hv-cinder-73362 May 11 06:06:09.530798 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-a4bed541-267c-4595-99b7-ac0911a02eb7 req-e865b8f4-a77d-4ed7-a00d-edfcc42f348d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098087 May 11 06:06:09.531613 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 602/1194] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:09.865594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c22dd58a-84bb-4e34-9b6f-caeb02eac098 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Action: 'create', calling method: .version_select at 0x7fa13aed4430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1160891402"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:10.164411 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c22dd58a-84bb-4e34-9b6f-caeb02eac098 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.547717 May 11 06:06:10.165120 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 593/1195] 10.222.0.44 () {60 vars in 1154 bytes} [Wed May 11 06:06:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 549 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 06:06:10.177686 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5baed483-3800-4bc8-ba0c-4fcaa2b5650d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1441d91f0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:10.230605 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5baed483-3800-4bc8-ba0c-4fcaa2b5650d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 345 microversion: 2.1 time: 0.057677 May 11 06:06:10.231188 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 603/1196] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:10 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:10.415650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:10.416262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:10.423758 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:10.424202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:10.424968 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:10.425399 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:10.558149 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:10.565555 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-852f3fb8-35a9-4f60-aca1-c88e7a0d9a15 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.154129 May 11 06:06:10.566156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 594/1197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:10 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:11.244462 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8e3f18ba-20f8-475d-a3bb-170df0944c91 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa14005d820>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:11.291908 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8e3f18ba-20f8-475d-a3bb-170df0944c91 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 346 microversion: 2.1 time: 0.051665 May 11 06:06:11.292478 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 604/1198] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:11 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:11.303447 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0e2894dc-c63e-4a16-9299-2e45894f7907 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Action: 'create', calling method: .version_select at 0x7fa13aed4430>, body: {"snapshot": {"volume_id": "f63877e4-9088-415d-96e6-1789a7a0cd7d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2071840455"}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:11.447828 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0e2894dc-c63e-4a16-9299-2e45894f7907 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.148156 May 11 06:06:11.449507 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 595/1199] 10.222.0.44 () {60 vars in 1161 bytes} [Wed May 11 06:06:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:11.459721 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-db148a3a-4e4c-4f90-bec3-c94a422c8d50 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1440e80d0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:11.488559 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-db148a3a-4e4c-4f90-bec3-c94a422c8d50 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.032800 May 11 06:06:11.489127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 605/1200] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:11 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:11.499935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4d93c6a0-c979-4115-a1fb-b03e87fbda14 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1402c9160>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:11.528425 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4d93c6a0-c979-4115-a1fb-b03e87fbda14 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033477 May 11 06:06:11.528978 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 596/1201] 10.222.0.44 () {58 vars in 1139 bytes} [Wed May 11 06:06:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:11.538730 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ce3e3567-77bb-4fb6-89fe-a524832194e5 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa14005d040>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:11.567876 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ce3e3567-77bb-4fb6-89fe-a524832194e5 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.032836 May 11 06:06:11.568441 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 606/1202] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:11 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:11.582156 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:11.582766 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:11.588805 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:11.589247 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:11.590041 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:11.590475 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:11.719294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:11.726486 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d05fffa6-6788-45e6-be2f-6d3c61bd768e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.148170 May 11 06:06:11.727042 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 597/1203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:11 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:12.580743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a522cd15-03a5-44a1-824b-34cf6ded276a tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa14409ed30>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:12.610769 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a522cd15-03a5-44a1-824b-34cf6ded276a tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.034300 May 11 06:06:12.611335 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 607/1204] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:12 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:12.744275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:12.744884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:12.751989 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:12.752433 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:12.753188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:12.753651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:12.880196 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:12.887496 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-fe62b346-6d06-4d91-81c3-38a508e9a4cb tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.147448 May 11 06:06:12.888316 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 598/1205] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:12 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:13.623122 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9dae3b46-33ff-4290-993d-03b1f56ebeb3 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa140095c10>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:13.652852 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9dae3b46-33ff-4290-993d-03b1f56ebeb3 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.033887 May 11 06:06:13.654347 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 608/1206] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:13 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:13.905590 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:13.906117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:13.912442 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:13.912882 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:13.913662 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:13.914092 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:14.045656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:14.053019 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-d50a1999-11a8-48b3-bf7e-06c29df6fbde tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1314 microversion: 2.1 time: 0.152160 May 11 06:06:14.053818 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 599/1207] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:13 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:14.666499 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0b9677c1-1fca-47d1-9702-a702a401552b tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa14005d8b0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:14.695602 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0b9677c1-1fca-47d1-9702-a702a401552b tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.033400 May 11 06:06:14.696171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 609/1208] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:14 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:15.072616 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:15.073226 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:15.079959 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:15.080421 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:15.081233 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:15.081702 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:15.209664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:15.218304 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-db894080-1e5e-4d19-a03d-c0a5627f93b9 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1498 microversion: 2.1 time: 0.149457 May 11 06:06:15.218872 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 600/1209] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:15 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:15.707954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-35ddce3e-3647-4750-a57e-7865adce4c5f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa140095160>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:15.735600 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-35ddce3e-3647-4750-a57e-7865adce4c5f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.031946 May 11 06:06:15.736170 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 610/1210] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:15 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:16.747945 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0e73de5d-3e3a-4d7b-8939-4afa75761e6f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1402c9d30>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:16.776714 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0e73de5d-3e3a-4d7b-8939-4afa75761e6f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.033140 May 11 06:06:16.777259 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 601/1211] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:16 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:17.788646 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-87f6f876-a411-4353-8a14-a93a594398e2 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1400ef1f0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:17.820061 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-87f6f876-a411-4353-8a14-a93a594398e2 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 288 microversion: 2.1 time: 0.035717 May 11 06:06:17.820620 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 611/1212] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:17 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:17.831043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-bdf3b88b-68e1-41fd-a68b-9fefbc066a90 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa13ad904c0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:17.886100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-bdf3b88b-68e1-41fd-a68b-9fefbc066a90 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 202 len: 0 microversion: 2.1 time: 0.059204 May 11 06:06:17.886685 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 602/1213] 10.222.0.44 () {58 vars in 1253 bytes} [Wed May 11 06:06:17 2022] DELETE /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:06:17.895378 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-37904115-daec-4d9c-87b3-656fd34d4393 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa140095dc0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:17.924343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-37904115-daec-4d9c-87b3-656fd34d4393 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.033030 May 11 06:06:17.924910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 612/1214] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:17 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:18.938129 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-12e79b58-a993-4a12-aaa4-f8cb8ed032c1 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa13ad90ca0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:18.965747 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-12e79b58-a993-4a12-aaa4-f8cb8ed032c1 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.033470 May 11 06:06:18.966395 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 603/1215] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:18 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:06:19.977451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-67bf7243-0c72-489b-87e9-b7539855bd75 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa14409e3a0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:20.006066 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-67bf7243-0c72-489b-87e9-b7539855bd75 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 200 len: 287 microversion: 2.1 time: 0.032951 May 11 06:06:20.006657 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 613/1216] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:19 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:20.894185 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:20.894699 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:20.900553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:20.900955 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:20.901752 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:20.902184 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:20.927855 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:06:21.005415 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-78aba448-1cd3-4217-a836-c3db70d49629 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 204 len: 0 microversion: 2.1 time: 0.115506 May 11 06:06:21.006032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 604/1217] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:06:20 2022] DELETE /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:06:21.016027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:21.016858 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:21.018288 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca4f1b0f-8a69-4349-b6b8-d7b7c78c1fd7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa13af03af0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:21.023631 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:21.024090 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:21.024864 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:21.025299 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:21.042729 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-ca4f1b0f-8a69-4349-b6b8-d7b7c78c1fd7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] HTTP exception thrown: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca4f1b0f-8a69-4349-b6b8-d7b7c78c1fd7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Request method failure captured: May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 HTTP/1.1 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JRNR1yzI8g7GkG_wOPNdRxMKNbgn3ApD1oY4zh-QKrZNj0aD_tc_tswAQsbhqxI-umCY1q8eFN9Y71H80ctL_V2WnAxqTWmLhFnGjWF7J7yjIlkh7dyVNHW3_wJO-dLqjhykYdb91zgdIsZ1rbhQFOu0BUjuHbA0tVXlY0fm4cMzQ May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:21.045749 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}] May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: e4f910b7074e4099a8d8bc1002c522fb May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7'} May 11 06:06:21.047414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. (HTTP 404) (Request-ID: req-0f471dbe-90a4-4d27-a19b-1a248bcc4e64) May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.051214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:21.052656 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 06:06:21.054117 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-ca4f1b0f-8a69-4349-b6b8-d7b7c78c1fd7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Returning 404 to user: Snapshot db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:21.055610 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ca4f1b0f-8a69-4349-b6b8-d7b7c78c1fd7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7" status: 404 len: 111 microversion: 2.1 time: 0.033346 May 11 06:06:21.056629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 605/1218] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 06:06:21 2022] GET /compute/v2.1/os-snapshots/db9b1b2c-6c1c-4cc9-9b72-3289a2ceceb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:06:21.056629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-71e3356e-cd91-4ed4-be70-531ba32eb800 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1402deb80>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:21.118548 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-71e3356e-cd91-4ed4-be70-531ba32eb800 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 202 len: 0 microversion: 2.1 time: 0.066451 May 11 06:06:21.119113 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 606/1219] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:06:21 2022] DELETE /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:06:21.127021 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-68f31f50-d4f7-4d3a-b5b2-105e5fd53fe7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1401f6f70>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:21.162416 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:21.169881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-17399b82-e1ae-40d2-a9c4-dac6aff9f180 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1504 microversion: 2.1 time: 0.159238 May 11 06:06:21.170472 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 614/1220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:21 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:21.176145 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-68f31f50-d4f7-4d3a-b5b2-105e5fd53fe7 tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 345 microversion: 2.1 time: 0.052695 May 11 06:06:21.177513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 607/1221] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:21 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:06:22.188226 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:22.188829 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-4903fd0b-c9cb-4489-8ca2-b516fe1fa6da tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1402c9a60>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:22.189221 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:22.195470 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:22.196005 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:22.196771 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:22.197556 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:22.237526 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-4903fd0b-c9cb-4489-8ca2-b516fe1fa6da tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 345 microversion: 2.1 time: 0.052692 May 11 06:06:22.238099 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 608/1222] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:22 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:22.324853 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:22.332463 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-11b78be9-4f90-4ae6-b116-edd808657868 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1504 microversion: 2.1 time: 0.149135 May 11 06:06:22.333028 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 615/1223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:22 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:23.251238 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-c1ffd957-e343-4fc7-92d9-78944ff4ac5a tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1400819d0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:23.298046 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-c1ffd957-e343-4fc7-92d9-78944ff4ac5a tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 345 microversion: 2.1 time: 0.051754 May 11 06:06:23.298609 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 609/1224] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:23 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:23.349162 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:23.349822 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:23.356121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:23.356571 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:23.358026 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:23.358467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:23.486793 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:23.494353 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1f9f0347-d296-4832-92f1-41cd6b36a03d tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1504 microversion: 2.1 time: 0.149077 May 11 06:06:23.494925 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 616/1225] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:23 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:24.311589 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-5c9fee66-58b4-488d-9fca-0439492e328f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa13ad0e4c0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:24.358182 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-5c9fee66-58b4-488d-9fca-0439492e328f tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 200 len: 345 microversion: 2.1 time: 0.051396 May 11 06:06:24.358755 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 610/1226] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:24 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:24.511998 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:24.512616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:24.519854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:24.520308 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:24.521082 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:24.521548 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:24.655531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:24.663410 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-fd770c56-e5b3-4ff6-a229-39318b4f6106 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1504 microversion: 2.1 time: 0.155293 May 11 06:06:24.663978 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 617/1227] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:24 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:25.372741 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1b094308-827e-4ee4-8206-8a88f758c75d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa1401f6dc0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:25.400806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-1b094308-827e-4ee4-8206-8a88f758c75d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] HTTP exception thrown: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1b094308-827e-4ee4-8206-8a88f758c75d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Request method failure captured: May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d HTTP/1.1 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JRNR1yzI8g7GkG_wOPNdRxMKNbgn3ApD1oY4zh-QKrZNj0aD_tc_tswAQsbhqxI-umCY1q8eFN9Y71H80ctL_V2WnAxqTWmLhFnGjWF7J7yjIlkh7dyVNHW3_wJO-dLqjhykYdb91zgdIsZ1rbhQFOu0BUjuHbA0tVXlY0fm4cMzQ May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:25.402844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}] May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: e4f910b7074e4099a8d8bc1002c522fb May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'f63877e4-9088-415d-96e6-1789a7a0cd7d'} May 11 06:06:25.404850 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. (HTTP 404) (Request-ID: req-e320470d-a8ad-420e-a287-69c8277f686a) May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.405757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:25.406962 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:06:25.408138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-1b094308-827e-4ee4-8206-8a88f758c75d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Returning 404 to user: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-1b094308-827e-4ee4-8206-8a88f758c75d tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 404 len: 109 microversion: 2.1 time: 0.036379 May 11 06:06:25.409426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 611/1228] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:25 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:25.415933 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-faffdb09-f1f1-4c66-875d-1299dec84eed tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa144070670>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:25.444684 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-faffdb09-f1f1-4c66-875d-1299dec84eed tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] HTTP exception thrown: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-faffdb09-f1f1-4c66-875d-1299dec84eed tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Request method failure captured: May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d HTTP/1.1 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1JRNR1yzI8g7GkG_wOPNdRxMKNbgn3ApD1oY4zh-QKrZNj0aD_tc_tswAQsbhqxI-umCY1q8eFN9Y71H80ctL_V2WnAxqTWmLhFnGjWF7J7yjIlkh7dyVNHW3_wJO-dLqjhykYdb91zgdIsZ1rbhQFOu0BUjuHbA0tVXlY0fm4cMzQ May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:25.447986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}] May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: e4f910b7074e4099a8d8bc1002c522fb May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'f63877e4-9088-415d-96e6-1789a7a0cd7d'} May 11 06:06:25.449727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. (HTTP 404) (Request-ID: req-0267af2e-9dbd-43eb-a9f5-81b6f1f94b74) May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.450725 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:25.452896 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:06:25.454399 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-faffdb09-f1f1-4c66-875d-1299dec84eed tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Returning 404 to user: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-faffdb09-f1f1-4c66-875d-1299dec84eed tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 404 len: 109 microversion: 2.1 time: 0.037607 May 11 06:06:25.455837 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 618/1229] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:06:25 2022] DELETE /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:25.458817 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b2257f4-541e-4349-b98b-e6cc8c78f8ef tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Calling method '.version_select at 0x7fa13af038b0>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:25.486634 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-7b2257f4-541e-4349-b98b-e6cc8c78f8ef tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] HTTP exception thrown: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b2257f4-541e-4349-b98b-e6cc8c78f8ef tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Request method failure captured: May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d HTTP/1.1 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JRNR1yzI8g7GkG_wOPNdRxMKNbgn3ApD1oY4zh-QKrZNj0aD_tc_tswAQsbhqxI-umCY1q8eFN9Y71H80ctL_V2WnAxqTWmLhFnGjWF7J7yjIlkh7dyVNHW3_wJO-dLqjhykYdb91zgdIsZ1rbhQFOu0BUjuHbA0tVXlY0fm4cMzQ May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:25.488650 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3733fcc038424890ab4b67f53e9dda26"}]}] May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 3733fcc038424890ab4b67f53e9dda26 May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-674219730 May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: e4f910b7074e4099a8d8bc1002c522fb May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesSnapshotsTestJSON-674219730-project May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'f63877e4-9088-415d-96e6-1789a7a0cd7d'} May 11 06:06:25.490324 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. (HTTP 404) (Request-ID: req-c30dd75e-b071-400d-a4b2-3f2046d2da33) May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.491294 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:25.492676 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:06:25.494173 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-7b2257f4-541e-4349-b98b-e6cc8c78f8ef tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] Returning 404 to user: Volume f63877e4-9088-415d-96e6-1789a7a0cd7d could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-7b2257f4-541e-4349-b98b-e6cc8c78f8ef tempest-VolumesSnapshotsTestJSON-674219730 tempest-VolumesSnapshotsTestJSON-674219730-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d" status: 404 len: 109 microversion: 2.1 time: 0.035321 May 11 06:06:25.495551 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 612/1230] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:25 2022] GET /compute/v2.1/os-volumes/f63877e4-9088-415d-96e6-1789a7a0cd7d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:25.682152 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:25.682857 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:25.693272 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:25.693986 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:25.694764 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:25.695286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:25.857494 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:25.864895 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f3820e8d-095d-4cb0-9487-41a38deecd36 tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1504 microversion: 2.1 time: 0.187986 May 11 06:06:25.865498 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 619/1231] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:25 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:26.085341 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1ade2cab-4c04-4fa0-ab03-7956bba6a4f0 req-2724a905-e7ca-47d2-af7c-67f7c12ddc20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab563fe-88a2-4733-b5bc-18d175afa2c8", "name": "network-vif-deleted", "tag": "e824ae60-2581-43d8-a494-eab1de9b34f1"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:26.095646 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1ade2cab-4c04-4fa0-ab03-7956bba6a4f0 req-2724a905-e7ca-47d2-af7c-67f7c12ddc20 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:26.096122 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1ade2cab-4c04-4fa0-ab03-7956bba6a4f0 req-2724a905-e7ca-47d2-af7c-67f7c12ddc20 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:26.107580 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1ade2cab-4c04-4fa0-ab03-7956bba6a4f0 req-2724a905-e7ca-47d2-af7c-67f7c12ddc20 service nova] Creating event network-vif-deleted:e824ae60-2581-43d8-a494-eab1de9b34f1 for instance eab563fe-88a2-4733-b5bc-18d175afa2c8 on hv-cinder-73362 May 11 06:06:26.113024 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1ade2cab-4c04-4fa0-ab03-7956bba6a4f0 req-2724a905-e7ca-47d2-af7c-67f7c12ddc20 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031804 May 11 06:06:26.114094 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 613/1232] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:06:26.883954 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:26.885294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:26.892505 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:26.892884 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:26.893875 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:26.894331 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:26.936632 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:26.937080 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:26.937881 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lazy-loading 'fault' on Instance uuid eab563fe-88a2-4733-b5bc-18d175afa2c8 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:06:26.988647 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e24c80364642b083dc32697f7320ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a40603d2f46d4ad2986e9277a47a8211', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:06:27.001225 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ead30d15-eddb-4b12-9b23-33187306a51e tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 200 len: 1304 microversion: 2.1 time: 0.122262 May 11 06:06:27.013127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 620/1233] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:26 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:06:27.172471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-087b46f4-6006-48d8-9339-115c53a35c49 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Action: 'create', calling method: .version_select at 0x7fa13ad0e0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-957246656", "metadata": {"Type": "work"}}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-087b46f4-6006-48d8-9339-115c53a35c49 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 121 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:27.195060 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-957246656", "metadata": {"Type": "work"}}} May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:27.196797 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-957246656', 'metadata': {'Type': 'work'}}}} May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise error May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi '#$%' May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.197844 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:06:27.199511 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:06:27.200773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 06:06:27.200773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.200773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-087b46f4-6006-48d8-9339-115c53a35c49 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.200773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-087b46f4-6006-48d8-9339-115c53a35c49 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.144931 May 11 06:06:27.200773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 614/1234] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 06:06:27.206979 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-051d79e5-d883-4d80-952e-c609106e7dbd tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Action: 'create', calling method: .version_select at 0x7fa14010f550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-567732560", "metadata": {"Type": "work"}}} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-051d79e5-d883-4d80-952e-c609106e7dbd tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 119 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:27.210194 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-567732560", "metadata": {"Type": "work"}}} May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: May 11 06:06:27.211809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-567732560', 'metadata': {'Type': 'work'}}}} May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise error May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi '0' May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.212701 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:06:27.214208 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:06:27.215432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 06:06:27.215432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.215432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-051d79e5-d883-4d80-952e-c609106e7dbd tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.215432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-051d79e5-d883-4d80-952e-c609106e7dbd tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008468 May 11 06:06:27.215432 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 621/1235] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 06:06:27.220905 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-deb8d8ea-1ada-41c7-9d1f-516820e9098d tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Action: 'create', calling method: .version_select at 0x7fa13afd3b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-544643014", "metadata": {"Type": "work"}}} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-deb8d8ea-1ada-41c7-9d1f-516820e9098d tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 118 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:27.224089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-544643014", "metadata": {"Type": "work"}}} May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:27.225513 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-544643014', 'metadata': {'Type': 'work'}}}} May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise error May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi '' May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.226366 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 06:06:27.227825 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 06:06:27.229003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 06:06:27.229003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.229003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-deb8d8ea-1ada-41c7-9d1f-516820e9098d tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.229003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-deb8d8ea-1ada-41c7-9d1f-516820e9098d tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008397 May 11 06:06:27.229003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 615/1236] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 06:06:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 06:06:27.238551 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-21a0b5cc-9659-49cd-957f-fbe999c4ab3e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Calling method '.version_select at 0x7fa1400e0dc0>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:27.266801 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-21a0b5cc-9659-49cd-957f-fbe999c4ab3e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] HTTP exception thrown: Volume tempest-invalid-253421527 could not be found. May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-21a0b5cc-9659-49cd-957f-fbe999c4ab3e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-253421527 HTTP/1.1 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:27.268752 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Volume tempest-invalid-253421527 could not be found. May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'tempest-invalid-253421527'} May 11 06:06:27.270526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-253421527 could not be found. (HTTP 404) (Request-ID: req-187205b5-1c48-4c7f-9327-c4a85dea7ad8) May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.275779 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:27.278110 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-253421527 could not be found. May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:27.284863 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-253421527 could not be found. May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-253421527 could not be found. May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-21a0b5cc-9659-49cd-957f-fbe999c4ab3e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 404 to user: Volume tempest-invalid-253421527 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-21a0b5cc-9659-49cd-957f-fbe999c4ab3e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-253421527" status: 404 len: 98 microversion: 2.1 time: 0.035381 May 11 06:06:27.286765 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 622/1237] 10.222.0.44 () {58 vars in 1214 bytes} [Wed May 11 06:06:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-253421527 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 11 06:06:27.288502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-ffdd58c5-4d96-408f-95bf-960a75c3854f tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003940 May 11 06:06:27.288502 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 616/1238] 10.222.0.44 () {58 vars in 1139 bytes} [Wed May 11 06:06:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 06:06:27.291612 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-201e56ae-0ed1-4f39-89d3-7824877cdd5e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004405 May 11 06:06:27.292254 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 623/1239] 10.222.0.44 () {58 vars in 1136 bytes} [Wed May 11 06:06:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 06:06:27.301618 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-94a26b3b-640e-45f4-b9d1-c4efff92db1e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Calling method '.version_select at 0x7fa1402de670>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:27.332413 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-94a26b3b-640e-45f4-b9d1-c4efff92db1e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] HTTP exception thrown: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-94a26b3b-640e-45f4-b9d1-c4efff92db1e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: DELETE /compute/v2.1/os-volumes/2270db45-156a-4d62-84a0-8cac79e44cda HTTP/1.1 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:27.334469 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '2270db45-156a-4d62-84a0-8cac79e44cda'} May 11 06:06:27.336141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. (HTTP 404) (Request-ID: req-b856d7c4-5d1b-4260-a0e0-f379fca2cd47) May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.337138 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 06:06:27.338594 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 06:06:27.340150 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-94a26b3b-640e-45f4-b9d1-c4efff92db1e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 404 to user: Volume 2270db45-156a-4d62-84a0-8cac79e44cda could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.341645 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-94a26b3b-640e-45f4-b9d1-c4efff92db1e tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2270db45-156a-4d62-84a0-8cac79e44cda" status: 404 len: 109 microversion: 2.1 time: 0.038877 May 11 06:06:27.342708 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 617/1240] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 06:06:27 2022] DELETE /compute/v2.1/os-volumes/2270db45-156a-4d62-84a0-8cac79e44cda => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:27.346570 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e7a20f21-5b97-405f-af8c-975a20ff5101 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Calling method '.version_select at 0x7fa140ffa040>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:27.375942 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-e7a20f21-5b97-405f-af8c-975a20ff5101 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] HTTP exception thrown: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e7a20f21-5b97-405f-af8c-975a20ff5101 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Request method failure captured: May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: GET /compute/v2.1/os-volumes/a989f0f7-4835-4c91-8594-423f73379ad4 HTTP/1.1 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1JiOJ1Ta6_dL7rDtNv9B8MiZ7BflVBiICXe0eHB2QpGTAk62QmH2VcOUf4U_Ql9n05NMO1FxMfFdBTWJvsUsn-TkwjY6qmhyh5Ufu0Ve8Ac_2-XRk1Ob5Dn129avO0afTOnWoyF8tAI--sYd66ecdMRxojEhTp5QiZi9r0fDHuI4K4 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:06:27.378008 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5477d6af43c84c988b0597e0d77231fc"}]}] May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 5477d6af43c84c988b0597e0d77231fc May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-VolumesNegativeTest-1113490892 May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: 08ce1e9bd5804bd7bbb47a970fc8c001 May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-VolumesNegativeTest-1113490892-project May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': 'a989f0f7-4835-4c91-8594-423f73379ad4'} May 11 06:06:27.379621 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. (HTTP 404) (Request-ID: req-dd6d5e37-1d34-41db-8d4b-d9aa50e8dd2f) May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.380504 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 06:06:27.381727 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 06:06:27.382957 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-e7a20f21-5b97-405f-af8c-975a20ff5101 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] Returning 404 to user: Volume a989f0f7-4835-4c91-8594-423f73379ad4 could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-e7a20f21-5b97-405f-af8c-975a20ff5101 tempest-VolumesNegativeTest-1113490892 tempest-VolumesNegativeTest-1113490892-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a989f0f7-4835-4c91-8594-423f73379ad4" status: 404 len: 109 microversion: 2.1 time: 0.038025 May 11 06:06:27.384197 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 624/1241] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 06:06:27 2022] GET /compute/v2.1/os-volumes/a989f0f7-4835-4c91-8594-423f73379ad4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:06:28.021292 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:06:28.022579 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] [instance: eab563fe-88a2-4733-b5bc-18d175afa2c8] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:06:28.030437 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:28.031211 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:28.031754 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:06:28.032271 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:06:28.049302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] HTTP exception thrown: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Request method failure captured: May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 HTTP/1.1 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1IlvHWG-wM0PFQOYa0inomD7Hl4e186D33nSKOvn9Iq8MrL5qZqFseSz_wf5JWd58QOusldsUcwvda2x9TEADMZgGLx0FtS-et1GDi8tOBA7QnJKvFcof5rzmkkFHu8OD31hEa2Rz56glkFWJEtGRxuX4uOZThPdI6KgnATlCmkRVg May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: a40603d2f46d4ad2986e9277a47a8211 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-VolumesActionsTest-323471262 May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:06:28.051101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a40603d2f46d4ad2986e9277a47a8211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a40603d2f46d4ad2986e9277a47a8211"}]}] May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-VolumesActionsTest-323471262 May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: a40603d2f46d4ad2986e9277a47a8211 May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-VolumesActionsTest-323471262 May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-VolumesActionsTest-323471262-project May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 34e24c80364642b083dc32697f7320ad May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-VolumesActionsTest-323471262-project May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. May 11 06:06:28.052984 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'eab563fe-88a2-4733-b5bc-18d175afa2c8'} May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:06:28.053865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. May 11 06:06:28.055160 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:06:28.056307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] Returning 404 to user: Instance eab563fe-88a2-4733-b5bc-18d175afa2c8 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:06:28.056307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0f00db79-2438-4060-b28c-d80cbe585aaf tempest-VolumesActionsTest-323471262 tempest-VolumesActionsTest-323471262-project] 10.222.0.44 "GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8" status: 404 len: 111 microversion: 2.1 time: 0.035254 May 11 06:06:28.056307 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 618/1242] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:06:28 2022] GET /compute/v2.1/servers/eab563fe-88a2-4733-b5bc-18d175afa2c8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 06:07:29.614956 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:29.615515 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:29.616200 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-351c3030-afa9-4304-b7d9-533262fbc8f9 req-dc835811-9c09-4780-9ade-3d31395d4327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:07:29.623467 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:29.623920 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:29.624692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:29.625128 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:29.625607 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-351c3030-afa9-4304-b7d9-533262fbc8f9 req-dc835811-9c09-4780-9ade-3d31395d4327 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:29.626188 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-351c3030-afa9-4304-b7d9-533262fbc8f9 req-dc835811-9c09-4780-9ade-3d31395d4327 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:29.638224 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-351c3030-afa9-4304-b7d9-533262fbc8f9 req-dc835811-9c09-4780-9ade-3d31395d4327 service nova] Creating event network-changed:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:07:29.643681 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-351c3030-afa9-4304-b7d9-533262fbc8f9 req-dc835811-9c09-4780-9ade-3d31395d4327 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032145 May 11 06:07:29.644368 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 619/1243] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:07:29.651805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:07:29.769808 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-4777f409-aec8-4681-9be4-f78cdc3f2472 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "DELETE /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 204 len: 0 microversion: 2.1 time: 0.163954 May 11 06:07:29.770923 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 625/1244] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:07:29 2022] DELETE /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:07:29.789202 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:29.790158 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:29.800499 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:29.801297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:29.802121 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:29.802567 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:29.954899 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:29.962601 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-6da6dc36-3518-40f3-9a2b-f902db873ee9 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.177740 May 11 06:07:29.963108 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 620/1245] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:29 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:30.980738 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:30.981540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:30.988090 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:30.988544 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:30.989351 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:30.989893 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:31.129521 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:31.137349 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0548266b-cf09-43ff-851f-fa1902a013b5 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1568 microversion: 2.1 time: 0.160826 May 11 06:07:31.137959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 626/1246] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:30 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:32.147303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-1b71c36c-4bc5-4b95-b1c9-788c3b3bc1eb req-11007c6f-9cc2-4087-9f1e-288a1a935a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83fc7441-7d03-47f5-b466-96344add4ec3", "name": "network-vif-deleted", "tag": "0f8bf64f-04f0-4b4a-97d2-7d0d321bf055"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:07:32.154578 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:32.155286 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:32.157871 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1b71c36c-4bc5-4b95-b1c9-788c3b3bc1eb req-11007c6f-9cc2-4087-9f1e-288a1a935a12 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:32.158312 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-1b71c36c-4bc5-4b95-b1c9-788c3b3bc1eb req-11007c6f-9cc2-4087-9f1e-288a1a935a12 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:32.161832 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:32.162294 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:32.163069 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:32.163506 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:32.170713 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-1b71c36c-4bc5-4b95-b1c9-788c3b3bc1eb req-11007c6f-9cc2-4087-9f1e-288a1a935a12 service nova] Creating event network-vif-deleted:0f8bf64f-04f0-4b4a-97d2-7d0d321bf055 for instance 83fc7441-7d03-47f5-b466-96344add4ec3 on hv-cinder-73362 May 11 06:07:32.176141 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-1b71c36c-4bc5-4b95-b1c9-788c3b3bc1eb req-11007c6f-9cc2-4087-9f1e-288a1a935a12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032564 May 11 06:07:32.176991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 621/1247] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:07:32.240337 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70d3a9e2d0a14433a9a8627d15b07ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3071f6c8fd64408fa45be4bc3a5c3f4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:32.248576 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-5266a7ef-df34-4852-a1d8-0e21e7ed3aee tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 200 len: 1381 microversion: 2.1 time: 0.097817 May 11 06:07:32.249153 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 627/1248] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:32 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 1381 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:07:33.268125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:33.268831 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] [instance: 83fc7441-7d03-47f5-b466-96344add4ec3] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:33.275053 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:33.275498 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:33.276292 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:33.276732 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:33.290707 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] HTTP exception thrown: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Request method failure captured: May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 HTTP/1.1 May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1FS73u9KLS-kPoXXLKpnAMW9F7Xwdek8TJCgPTwi8TzPcZhdxZxZLk8iVmxK_Ql0Bh2TFkv6umOqYOFCysXw4iPuji8QN5iQrK1Sb6UwllaRtLsOvPcAWrI4EJk_pitl1nGvJE0x50bv-8qYMe_AGkZcLV8eJkCXdudOLjTRm__ZCs May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 3071f6c8fd64408fa45be4bc3a5c3f4d May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-TestShelveInstance-1642262000 May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:07:33.292326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3071f6c8fd64408fa45be4bc3a5c3f4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3071f6c8fd64408fa45be4bc3a5c3f4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3071f6c8fd64408fa45be4bc3a5c3f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3071f6c8fd64408fa45be4bc3a5c3f4d"}]}] May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-TestShelveInstance-1642262000 May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 3071f6c8fd64408fa45be4bc3a5c3f4d May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-TestShelveInstance-1642262000 May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-TestShelveInstance-1642262000-project May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: 70d3a9e2d0a14433a9a8627d15b07ff1 May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-TestShelveInstance-1642262000-project May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. May 11 06:07:33.294414 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '83fc7441-7d03-47f5-b466-96344add4ec3'} May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:07:33.295426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. May 11 06:07:33.297035 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:07:33.298515 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Returning 404 to user: Instance 83fc7441-7d03-47f5-b466-96344add4ec3 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:07:33.298515 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-194bb331-d61b-4881-89db-5ff8e4026897 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3" status: 404 len: 111 microversion: 2.1 time: 0.031762 May 11 06:07:33.298515 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 622/1249] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:33 2022] GET /compute/v2.1/servers/83fc7441-7d03-47f5-b466-96344add4ec3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:07:33.470873 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1df6de99-3efa-47ce-8b07-ca0a11eacd53 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] Calling method '.version_select at 0x7fa14008db80>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:33.489182 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1df6de99-3efa-47ce-8b07-ca0a11eacd53 tempest-TestShelveInstance-1642262000 tempest-TestShelveInstance-1642262000-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1484454940" status: 202 len: 0 microversion: 2.1 time: 0.024630 May 11 06:07:33.489824 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 628/1250] 10.222.0.44 () {58 vars in 1253 bytes} [Wed May 11 06:07:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1484454940 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 06:07:44.703168 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:44.704426 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:44.706142 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-115a4379-a3a9-4fef-891c-b435f65dfb32 req-c5a6c15b-4cf2-4161-94e5-8b1f78c8bd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:07:44.711040 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:44.711746 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:44.712560 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:44.713003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:44.715406 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-115a4379-a3a9-4fef-891c-b435f65dfb32 req-c5a6c15b-4cf2-4161-94e5-8b1f78c8bd6a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:44.715987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-115a4379-a3a9-4fef-891c-b435f65dfb32 req-c5a6c15b-4cf2-4161-94e5-8b1f78c8bd6a service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:44.727247 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-115a4379-a3a9-4fef-891c-b435f65dfb32 req-c5a6c15b-4cf2-4161-94e5-8b1f78c8bd6a service nova] Creating event network-changed:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:07:44.732616 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-115a4379-a3a9-4fef-891c-b435f65dfb32 req-c5a6c15b-4cf2-4161-94e5-8b1f78c8bd6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030898 May 11 06:07:44.733217 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 629/1251] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:07:44.742773 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Going to try to terminate instance {{(pid=117335) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:07:44.830317 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-2b4f199e-2826-4d72-bd11-a8105f5aec70 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 204 len: 0 microversion: 2.1 time: 0.130760 May 11 06:07:44.831302 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 623/1252] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:07:44 2022] DELETE /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:07:44.840423 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:44.841343 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:44.848094 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:44.848617 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:44.849446 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:44.849926 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:44.998951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:45.007805 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9f9ef6ac-2488-4803-bf28-d6b0c43734b0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.172008 May 11 06:07:45.008492 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 630/1253] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:44 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:46.029311 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:46.030055 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:46.036553 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:46.037007 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:46.037813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:46.038256 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:46.171578 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:46.179282 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-827a69d8-a71e-462b-a516-2e807d6de7cf tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.155268 May 11 06:07:46.179865 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 624/1254] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:46 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:47.198227 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:47.199007 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:47.205552 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:47.205923 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:47.206641 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:47.207252 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:47.538659 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:47.546529 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-6cec2a83-878c-4bc8-b514-ffc08f0292c4 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.352945 May 11 06:07:47.547109 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 631/1255] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:47 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:48.563885 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:48.564494 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:48.570976 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:48.571423 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:48.572178 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:48.572606 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:48.754299 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:48.761566 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-77e65377-dc85-4f63-b072-9eb51dbc5bf0 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.201882 May 11 06:07:48.762126 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 625/1256] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:48 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:49.779473 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:49.780702 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:49.787072 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:49.787526 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:49.788305 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:49.788749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:49.838464 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-b528a658-a275-4e35-bea4-53f8969ab042 req-2db0047d-479c-438c-af51-cf098714bb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "name": "network-vif-unplugged", "status": "completed", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:07:49.849214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-b528a658-a275-4e35-bea4-53f8969ab042 req-2db0047d-479c-438c-af51-cf098714bb9e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:49.850362 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-b528a658-a275-4e35-bea4-53f8969ab042 req-2db0047d-479c-438c-af51-cf098714bb9e service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:49.864497 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-b528a658-a275-4e35-bea4-53f8969ab042 req-2db0047d-479c-438c-af51-cf098714bb9e service nova] Creating event network-vif-unplugged:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:07:49.869620 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-b528a658-a275-4e35-bea4-53f8969ab042 req-2db0047d-479c-438c-af51-cf098714bb9e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034764 May 11 06:07:49.870391 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 626/1257] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 06:07:49.931501 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:49.939583 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-f3dc09b3-01a6-4506-b7e5-84a0410497f3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.163996 May 11 06:07:49.940156 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 632/1258] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:49 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:50.958015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:50.958719 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:50.965022 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:50.965495 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:50.966265 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:50.966723 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:51.101806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:51.109731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-30cb48c3-258b-49a2-8bf5-c42582bc86f1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.156602 May 11 06:07:51.110297 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 627/1259] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:50 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:52.125880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:52.126495 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:52.133199 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:52.133683 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:52.134451 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:52.134883 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:52.263511 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:52.271102 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-de8697c3-149b-41d0-b365-9d08cedaf7c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.149124 May 11 06:07:52.271668 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 633/1260] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:52 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:52.395471 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:07:52.395946 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Wed May 11 06:07:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:07:53.288709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:53.289370 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:53.296015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:53.296465 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:53.297230 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:53.297705 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:53.428583 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:53.436757 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-0a5920d6-51fa-46fa-b75d-ee2528b48fbc tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.151282 May 11 06:07:53.437260 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 628/1261] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:53 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:54.453542 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:54.454126 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:54.460478 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:54.460938 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:54.461750 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:54.462196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:54.592623 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:54.600456 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0292d3b9-d0ff-4fa6-93b3-fbb1bcc10344 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.150906 May 11 06:07:54.601027 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 634/1262] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:54 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:55.617595 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:55.618216 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:55.625069 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:55.625554 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:55.626326 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:55.626765 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:55.755510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:55.762772 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-424613c4-0805-48da-800f-2cbacd0aa4b8 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.149083 May 11 06:07:55.763334 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 629/1263] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:55 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:56.781244 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:56.781888 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:56.788271 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:56.788729 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:56.789540 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:56.789984 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:56.917816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:56.925827 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-3addb92b-c248-4f0d-85a4-e98c1ff41e3d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.149064 May 11 06:07:56.926395 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 635/1264] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:56 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:57.943153 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:57.943764 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:57.950152 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:57.950603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:57.951367 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:57.951806 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:58.079603 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:58.086991 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-58360389-91e7-4ea7-bc33-c03008fa06c6 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.147768 May 11 06:07:58.087593 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 630/1265] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:57 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:59.104730 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:07:59.105348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:07:59.111651 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:59.112098 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:59.112952 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:07:59.113387 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:07:59.244127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:07:59.252178 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-9dcb3394-d966-439e-a461-359c0d450385 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1578 microversion: 2.1 time: 0.151390 May 11 06:07:59.252742 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 636/1266] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:07:59 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:07:59.997177 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-38092192-e231-4fcf-84ce-9ecfd6c8d254 req-1a104931-28ff-453c-a9f9-cdaa3fabdf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ac84cd-cc2c-4830-a418-8c0da4209794", "name": "network-vif-deleted", "tag": "e01bd856-16c0-47b7-8812-e2f89cf52869"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:08:00.006853 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-38092192-e231-4fcf-84ce-9ecfd6c8d254 req-1a104931-28ff-453c-a9f9-cdaa3fabdf54 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:00.007409 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-38092192-e231-4fcf-84ce-9ecfd6c8d254 req-1a104931-28ff-453c-a9f9-cdaa3fabdf54 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:00.020424 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-38092192-e231-4fcf-84ce-9ecfd6c8d254 req-1a104931-28ff-453c-a9f9-cdaa3fabdf54 service nova] Creating event network-vif-deleted:e01bd856-16c0-47b7-8812-e2f89cf52869 for instance c0ac84cd-cc2c-4830-a418-8c0da4209794 on hv-cinder-73362 May 11 06:08:00.025365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-38092192-e231-4fcf-84ce-9ecfd6c8d254 req-1a104931-28ff-453c-a9f9-cdaa3fabdf54 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 May 11 06:08:00.026042 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 631/1267] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:08:00.269630 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:00.270260 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:00.278531 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:00.279046 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:00.280257 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:00.280994 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:00.349328 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:00.358171 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-d285f0d1-f786-4389-985d-1a585f3edd56 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 200 len: 1225 microversion: 2.1 time: 0.092193 May 11 06:08:00.359309 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 637/1268] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:00 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:01.377067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:01.377702 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: c0ac84cd-cc2c-4830-a418-8c0da4209794] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:01.383800 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:01.384245 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:01.385003 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:01.385435 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:01.398760 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] HTTP exception thrown: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Request method failure captured: May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 HTTP/1.1 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1C46m7QvIVDRHVF3nPG-nfVU1aQwxv3nVZIDtaEDq7JM0LtWRY0usuQELmt0V9y1oQbEx1351QwdWFFumOBhs9jgJIPWUPEZ0FfEMYN_GgKVUvfW8zHemilDQL5HqqU3xLdpwacAfvIKrbSKypCT8T73zy0_g3UdawPl3zkhtp9dfA May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:08:01.400400 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}] May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-TestVolumeBootPattern-470242454 May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: bbc14e1f89334e65b24fec7b4a321c5d May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. May 11 06:08:01.402214 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': 'c0ac84cd-cc2c-4830-a418-8c0da4209794'} May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:08:01.403261 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. May 11 06:08:01.405204 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:01.406748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Returning 404 to user: Instance c0ac84cd-cc2c-4830-a418-8c0da4209794 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:08:01.406748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-48894523-5df4-4e23-a1e7-91d4750d637b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794" status: 404 len: 111 microversion: 2.1 time: 0.030090 May 11 06:08:01.406748 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 632/1269] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:01 2022] GET /compute/v2.1/servers/c0ac84cd-cc2c-4830-a418-8c0da4209794 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:08:04.464651 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-ce06296b-9eed-435c-807b-3624e878528f req-befee6d0-8760-4211-a6fa-00e0dbb57440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:08:04.475692 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:04.476345 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:04.482084 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ce06296b-9eed-435c-807b-3624e878528f req-befee6d0-8760-4211-a6fa-00e0dbb57440 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:04.483444 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-ce06296b-9eed-435c-807b-3624e878528f req-befee6d0-8760-4211-a6fa-00e0dbb57440 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:04.483910 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:04.484497 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:04.485301 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:04.485778 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:04.496439 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-ce06296b-9eed-435c-807b-3624e878528f req-befee6d0-8760-4211-a6fa-00e0dbb57440 service nova] Creating event network-changed:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:08:04.502635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-ce06296b-9eed-435c-807b-3624e878528f req-befee6d0-8760-4211-a6fa-00e0dbb57440 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041340 May 11 06:08:04.503625 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 633/1270] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:08:04.515482 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Going to try to terminate instance {{(pid=117334) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 06:08:04.603409 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-2f276806-1a32-4229-882d-2a406678a491 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "DELETE /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 204 len: 0 microversion: 2.1 time: 0.143919 May 11 06:08:04.606447 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 638/1271] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:08:04 2022] DELETE /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 06:08:04.616089 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:04.616789 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:04.628813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:04.629275 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:04.630702 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:04.631143 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:04.768629 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:04.775938 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-595afa87-1f1d-435a-917b-47d5adf7f0e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.164759 May 11 06:08:04.776505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 634/1272] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:04 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:05.794034 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:05.794743 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:05.811524 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:05.811992 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:05.812814 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:05.813430 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:05.953311 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:05.961644 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8480b0da-1b23-45ac-95f2-81c6b51c3650 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.172251 May 11 06:08:05.962812 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 639/1273] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:05 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:06.980727 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:06.981481 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:06.988855 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:06.989308 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:06.990107 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:06.990536 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:07.160191 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:07.167709 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-38a84dc9-ae9e-4ce6-bd4b-2db01250a5e7 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.191206 May 11 06:08:07.168485 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 635/1274] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:06 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:08.185809 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:08.186365 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:08.194918 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:08.195749 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:08.196543 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:08.196987 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:08.344959 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:08.354880 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-ccd7d39e-180c-4f47-833c-7c316343f57e tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.172997 May 11 06:08:08.355843 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 640/1275] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:08 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:09.371878 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:09.373381 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:09.381318 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:09.381792 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:09.382577 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:09.383015 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:09.523848 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:09.531492 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e5480042-d409-4e94-9e3c-f2518047c465 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.163431 May 11 06:08:09.532067 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 636/1276] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:09 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:09.925267 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [req-37f2cb56-ffb2-40d4-a30e-46b4f7312dab req-2e752e12-db59-4884-9979-69537e8d293b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "name": "network-vif-unplugged", "status": "completed", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:08:09.933537 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-37f2cb56-ffb2-40d4-a30e-46b4f7312dab req-2e752e12-db59-4884-9979-69537e8d293b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:09.934038 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [req-37f2cb56-ffb2-40d4-a30e-46b4f7312dab req-2e752e12-db59-4884-9979-69537e8d293b service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:09.946127 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.compute.server_external_events [req-37f2cb56-ffb2-40d4-a30e-46b4f7312dab req-2e752e12-db59-4884-9979-69537e8d293b service nova] Creating event network-vif-unplugged:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:08:09.951121 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [req-37f2cb56-ffb2-40d4-a30e-46b4f7312dab req-2e752e12-db59-4884-9979-69537e8d293b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030279 May 11 06:08:09.951722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 641/1277] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:08:10.547824 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:10.548438 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:10.554813 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:10.555262 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:10.556032 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:10.556466 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:10.685664 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:10.693044 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e515f846-450f-48b0-91bc-058d3be5a4a1 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.149258 May 11 06:08:10.693628 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 637/1278] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:10 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:11.711635 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:11.712268 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:11.719134 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:11.719594 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:11.720371 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:11.720816 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:11.851318 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:11.859405 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-8910b51b-4c6a-4786-8076-8cf98c07938d tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.151853 May 11 06:08:11.859949 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 642/1279] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:11 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 06:08:12.876860 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:12.877503 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:12.883852 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:12.884303 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:12.885058 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:12.885523 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:13.021072 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.policy [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117335) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:13.029347 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-81993c88-01fd-4559-9b3e-a7349ea95d83 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.156579 May 11 06:08:13.029947 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 638/1280] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:12 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:14.047801 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:14.048466 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:14.055051 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:14.055507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:14.056283 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:14.056726 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:14.234931 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:14.243236 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-c5e97f82-6778-4619-822b-64e4411a029b tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1575 microversion: 2.1 time: 0.199883 May 11 06:08:14.243854 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 643/1281] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:14 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:14.633884 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [req-63fdfd3c-a67b-4378-b923-706b4ed95d04 req-d29b663d-8516-42ca-b1cb-20b7f1350337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42279c9f-6113-43fa-9770-3f314e47fc23", "name": "network-vif-deleted", "tag": "d16db98a-a519-4d1f-ab25-011ce93ea9b3"}]} {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 06:08:14.643505 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-63fdfd3c-a67b-4378-b923-706b4ed95d04 req-d29b663d-8516-42ca-b1cb-20b7f1350337 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:14.643956 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [req-63fdfd3c-a67b-4378-b923-706b4ed95d04 req-d29b663d-8516-42ca-b1cb-20b7f1350337 service nova] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:14.655101 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.compute.server_external_events [req-63fdfd3c-a67b-4378-b923-706b4ed95d04 req-d29b663d-8516-42ca-b1cb-20b7f1350337 service nova] Creating event network-vif-deleted:d16db98a-a519-4d1f-ab25-011ce93ea9b3 for instance 42279c9f-6113-43fa-9770-3f314e47fc23 on hv-cinder-73362 May 11 06:08:14.661066 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [req-63fdfd3c-a67b-4378-b923-706b4ed95d04 req-d29b663d-8516-42ca-b1cb-20b7f1350337 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 May 11 06:08:14.662012 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 639/1282] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 06:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 06:08:15.261739 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:15.262357 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:15.269963 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:15.270422 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:15.271196 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:15.271637 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:15.304973 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:15.305425 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:15.305911 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.objects.instance [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lazy-loading 'fault' on Instance uuid 42279c9f-6113-43fa-9770-3f314e47fc23 {{(pid=117334) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 06:08:15.350828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.policy [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbc14e1f89334e65b24fec7b4a321c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12ba636dcfc34045b8b7fd82fa770bc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117334) authorize /opt/stack/nova/nova/policy.py:199}} May 11 06:08:15.361147 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-0172824a-8f26-4217-af48-d468f9f34ee3 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 200 len: 1228 microversion: 2.1 time: 0.103287 May 11 06:08:15.361782 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 644/1283] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:15 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 06:08:16.381944 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:16.382633 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 42279c9f-6113-43fa-9770-3f314e47fc23] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:16.388655 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.389125 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.389935 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.390365 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.404100 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] HTTP exception thrown: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Request method failure captured: May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 HTTP/1.1 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1C46m7QvIVDRHVF3nPG-nfVU1aQwxv3nVZIDtaEDq7JM0LtWRY0usuQELmt0V9y1oQbEx1351QwdWFFumOBhs9jgJIPWUPEZ0FfEMYN_GgKVUvfW8zHemilDQL5HqqU3xLdpwacAfvIKrbSKypCT8T73zy0_g3UdawPl3zkhtp9dfA May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:08:16.406194 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}] May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: bbc14e1f89334e65b24fec7b4a321c5d May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. May 11 06:08:16.407851 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '42279c9f-6113-43fa-9770-3f314e47fc23'} May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:08:16.408954 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. May 11 06:08:16.410635 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.412258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Returning 404 to user: Instance 42279c9f-6113-43fa-9770-3f314e47fc23 could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:08:16.412258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-a4a58139-15d6-4894-85b5-50859dfa5987 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23" status: 404 len: 111 microversion: 2.1 time: 0.030309 May 11 06:08:16.412258 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 640/1284] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:16 2022] GET /compute/v2.1/servers/42279c9f-6113-43fa-9770-3f314e47fc23 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:08:16.699270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:08:16.699831 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Wed May 11 06:08:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:08:16.837346 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:16.837885 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.compute.api [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117334) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:16.844565 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.845018 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.845828 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.846270 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG oslo_concurrency.lockutils [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.859951 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.wsgi [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] HTTP exception thrown: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Request method failure captured: May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: request: DELETE /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a HTTP/1.1 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept: application/json May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Accept-Encoding: identity May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Connection: close May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Length: 0 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Content-Type: application/json May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Host: 10.222.0.44 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Openstack-System-Scope: None May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: User-Agent: python-urllib3/1.26.9 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Auth-Token: gAAAAABie1C46m7QvIVDRHVF3nPG-nfVU1aQwxv3nVZIDtaEDq7JM0LtWRY0usuQELmt0V9y1oQbEx1351QwdWFFumOBhs9jgJIPWUPEZ0FfEMYN_GgKVUvfW8zHemilDQL5HqqU3xLdpwacAfvIKrbSKypCT8T73zy0_g3UdawPl3zkhtp9dfA May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Id: None May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Domain-Name: None May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Identity-Status: Confirmed May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Is-Admin-Project: True May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Id: default May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Domain-Name: Default May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Project-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Role: member,reader May 11 06:08:16.861619 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Roles: member,reader May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}] May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-Tenant-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Id: default May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Domain-Name: Default May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Id: bbc14e1f89334e65b24fec7b4a321c5d May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: X-User-Name: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: method: > May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: exception: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.863238 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: action_args: {'id': '56072492-2dc2-4297-81ad-5f56dd97e54a'} May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:08:16.864455 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.866047 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: ERROR nova.api.openstack.wsgi May 11 06:08:16.867734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Returning 404 to user: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. {{(pid=117334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:08:16.867734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-a8dc111c-099b-4f37-ba94-123a174de391 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "DELETE /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 404 len: 111 microversion: 2.1 time: 0.029575 May 11 06:08:16.867734 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 645/1285] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 06:08:16 2022] DELETE /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:08:16.871431 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '>' {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:16.872043 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.compute.api [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] [instance: 56072492-2dc2-4297-81ad-5f56dd97e54a] Fetching instance by UUID {{(pid=117335) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 06:08:16.878591 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.879039 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.879804 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 06:08:16.880240 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG oslo_concurrency.lockutils [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Lock "890801eb-2d5b-42d0-96a3-e70da598d966" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 06:08:16.893510 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.wsgi [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] HTTP exception thrown: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Request method failure captured: May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: request: GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a HTTP/1.1 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept: application/json May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Accept-Encoding: identity May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Connection: close May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Length: 0 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Content-Type: application/json May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Host: 10.222.0.44 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Openstack-System-Scope: None May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: User-Agent: python-urllib3/1.26.9 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Auth-Token: gAAAAABie1C46m7QvIVDRHVF3nPG-nfVU1aQwxv3nVZIDtaEDq7JM0LtWRY0usuQELmt0V9y1oQbEx1351QwdWFFumOBhs9jgJIPWUPEZ0FfEMYN_GgKVUvfW8zHemilDQL5HqqU3xLdpwacAfvIKrbSKypCT8T73zy0_g3UdawPl3zkhtp9dfA May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Id: None May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Domain-Name: None May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Identity-Status: Confirmed May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Is-Admin-Project: True May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Id: default May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Domain-Name: Default May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Project-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Role: member,reader May 11 06:08:16.895009 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Roles: member,reader May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/12ba636dcfc34045b8b7fd82fa770bc0"}]}] May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Id: 12ba636dcfc34045b8b7fd82fa770bc0 May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-Tenant-Name: tempest-TestVolumeBootPattern-470242454 May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Id: default May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Domain-Name: Default May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Id: bbc14e1f89334e65b24fec7b4a321c5d May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: X-User-Name: tempest-TestVolumeBootPattern-470242454-project May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: method: > May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: exception: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.896683 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: action_args: {'id': '56072492-2dc2-4297-81ad-5f56dd97e54a'} May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: {{(pid=117335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 06:08:16.897888 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. May 11 06:08:16.899407 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: ERROR nova.api.openstack.wsgi May 11 06:08:16.900926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: DEBUG nova.api.openstack.wsgi [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Returning 404 to user: Instance 56072492-2dc2-4297-81ad-5f56dd97e54a could not be found. {{(pid=117335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 06:08:16.900926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO nova.api.openstack.requestlog [None req-e99c988e-128c-4be8-be5b-f4ef353c5106 tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a" status: 404 len: 111 microversion: 2.1 time: 0.028765 May 11 06:08:16.900926 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: [pid: 117335|app: 0|req: 641/1286] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 06:08:16 2022] GET /compute/v2.1/servers/56072492-2dc2-4297-81ad-5f56dd97e54a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 06:08:18.184507 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: DEBUG nova.api.openstack.wsgi [None req-1a22cd8a-c83e-4fca-b2fc-53b774c5a3ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] Calling method '.version_select at 0x7fa1400e0c10>' {{(pid=117334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 06:08:18.207586 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO nova.api.openstack.requestlog [None req-1a22cd8a-c83e-4fca-b2fc-53b774c5a3ec tempest-TestVolumeBootPattern-470242454 tempest-TestVolumeBootPattern-470242454-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-860430622" status: 202 len: 0 microversion: 2.1 time: 0.026911 May 11 06:08:18.208174 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: [pid: 117334|app: 0|req: 646/1287] 10.222.0.44 () {58 vars in 1259 bytes} [Wed May 11 06:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-860430622 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 06:11:12.404731 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:11:12.405408 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Wed May 11 06:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:11:18.352252 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:11:18.352907 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Wed May 11 06:11:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:11:31.773569 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:11:31.774184 dv-cinder-733623-13-iscsi devstack@n-api.service[117335]: Wed May 11 06:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:11:36.708722 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:11:36.709348 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Wed May 11 06:11:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 06:13:24.611089 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 06:13:24.611785 dv-cinder-733623-13-iscsi devstack@n-api.service[117334]: Wed May 11 06:13:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!